Getting Data In

How do I get Splunk to recognise epoch time?

himynamesdave
Contributor

I have a static JSON file (240k lines) I would like to index. Here's a the format:

{"name":"fuel_level","value":88.260948,"timestamp":1362061287.027000}
{"name":"fuel_level","value":88.260948,"timestamp":1362061287.035000}
{"name":"fuel_level","value":88.260948,"timestamp":1362061287.064000}
{"name":"fuel_level","value":88.260948,"timestamp":1362061287.098000}
{"name":"fuel_level","value":88.260948,"timestamp":1362061287.110000}
{"name":"fuel_level","value":88.260948,"timestamp":1362061287.143000}
{"name":"fuel_level","value":88.260948,"timestamp":1362061287.154000}
{"name":"fuel_level","value":88.260948,"timestamp":1362061287.177000}

In the data preview mode Splunk is assigning the timestamp based on the last time the file was changed, not the timestamp variable of the event.

How can I get Splunk (using 6) to recognise the timestamp of the event?

i've tried playing with the ../props.conf file based on previous answers but have been unsuccessful so far.

Tags (2)
0 Karma
1 Solution

adrianathome
Communicator

It would be helpful if you post the format that you tried in props.conf.

It should be as follows:

TIME_FORMAT = %s.%6N

View solution in original post

adrianathome
Communicator

It would be helpful if you post the format that you tried in props.conf.

It should be as follows:

TIME_FORMAT = %s.%6N

himynamesdave
Contributor

Thanks! This is what I was originally trying, my mistake was not declaring:

TIME_PREFIX="timestamp":

0 Karma

jtrucks
Splunk Employee
Splunk Employee

Check out props.conf docs and read the Timestamp extraction configuration section.

The likely answer is in this part:

TIME_FORMAT = <strptime-style format>
* Specifies a strptime format string to extract the date.
* strptime is an industry standard for designating time formats.
* For more information on strptime, see "Configure timestamp recognition" in
  the online documentation.
* TIME_FORMAT starts reading after the TIME_PREFIX. If both are specified, the TIME_PREFIX
  regex must match up to and including the character before the TIME_FORMAT date.
* For good results, the <strptime-style format> should describe the day of the year and the
  time of day.
* Defaults to empty.

This references the Configure timestamp recognition docs which should help you tons, especially the Enhanced strptime() support part.

--
Jesse Trucks
Minister of Magic
Get Updates on the Splunk Community!

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...