Getting Data In

How to automate the deletion of some data in a CSV file before indexing?

spin691t
New Member

Hello

Every day at 10:00 am, I receive a .csv file with data from 00:00 of the previous day until 10:00 of the current day (34 hours).

I would like to index only the data of the previous day. Currently I open each file, remove data from 00:00 to 10:00 of the current date, save in an index directory and index in Splunk. Do I have to write a script or set a configuration file for an automatic operation?

Thank you in advance.

Tags (3)
0 Karma

somesoni2
Revered Legend

I would write a script to truncate the file and drop it to Splunk monitored folder OR to just configure that script as Scripted input and make script to send data to Splunk directly (no file monitoring required).

spin691t
New Member

Thank you for your answer. What language Is better to write script phyton or perl or ..?

0 Karma

slashnburn
Path Finder

I would recommend Python. From there you can create a scripted input that performs the operation at a specific time.

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...