Getting Data In

Removing CSV Header from Indexing

srsava
New Member

Hello Splunk Community,

I uploaded custom CSV files to Splunk for indexing. The CSV Header for each file is being indexed with a time stamp for the day the file is uploaded. I do not want the CSV Header returned in the results. I have looked through the answer.splunk knowledge base and attempted to configure the props.conf and transforms.conf as suggested by other users. I am not achieving the results I desire. I am still indexing the CSV Header as an event when the Header should just be ignored.

My Headers include Number, Date Time, Service, Source Port, Source, Destination, Protocol

Please help if possible.

Tags (1)
0 Karma

fk319
Builder

How are you importin your CSV files, inputcsv ?


There is an option start=<int> that starts importing after <int> lines.

0 Karma

mikelanghorst
Motivator

You can simply null-queue the event with the header. Look for the section titled: "Filter event data and send to queues" here in the docs
http://www.splunk.com/base/Documentation/4.2.2/Deploy/Routeandfilterdatad

RicoSuave
Builder

I have run into the same issue. I just end up deleting that particular event. Click on the event to isolate it in the results, then just pipe it to delete:

| delete

Make sure you have the can delete role or else it wont work.

0 Karma

srsava
New Member

Thanks for your help, Although this WILL remove the Header after it is indexed, I have hundreds of CSV files I am collecting and will be indexing for this project. Can someone explain the method to remove the CSV header from being published as an event? Why does splunk assign a datetime to the CSV header?...based off the datetime the file was created? I would like to configure the Splunk instance to monitor a file location for any changes and NOT publish the CSV header as an event. I do not want to have to delete each CSV Header instance as they are indexed or perhaps re-indexed.

0 Karma
Get Updates on the Splunk Community!

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...