Getting Data In

How to Read a CSV file (with time-stamped data for past 24 hours) and Index the data

htkwan
Path Finder

Hello All,
My client's machine generates a daily data log (in csv format). How do one configure splunk to read & index the past 1 day of data. The csv file has the following format.
Header >> Datetime, Tag1, Tag2
Row1 >> 2017-07-01 23:00:00, 23.45, 12.56
Row2 >> 2017-07-01 23:01:00, 33.45, 22.56

Pls. advise. Thanks

Tags (2)

sbbadri
Motivator

Please see below,

create $SPLUNK_HOME/etc/apps/yourapp/local/inputs.conf

[monitor://$SPLUNK_HOME/input/myfile.csv]
host=myhost
source=mysource
sourcetype=mysourcetype
index=myindex

$SPLUNK_HOME/etc/apps/your app/local/props.conf
[source::mysource]
REPORT-mysource = mysource_csv

$SPLUNK_HOME/etc/apps/yourapp/local/transforms.conf
[mysource_csv]
DELIMS = ","
FIELDS = "field1","field2","field3","field4","field5".....

Go through below link for further details,

http://docs.splunk.com/Documentation/Splunk/6.2.1/Data/Extractfieldsfromfileheadersatindextime

htkwan
Path Finder

Thanks very much

0 Karma

woodcock
Esteemed Legend

If you got it working, do click Accept to close your question.

0 Karma
Get Updates on the Splunk Community!

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...

Updated Team Landing Page in Splunk Observability

We’re making some changes to the team landing page in Splunk Observability, based on your feedback. The ...