Getting Data In

Removing CSV Header from Indexing

srsava
New Member

Hello Splunk Community,

I uploaded custom CSV files to Splunk for indexing. The CSV Header for each file is being indexed with a time stamp for the day the file is uploaded. I do not want the CSV Header returned in the results. I have looked through the answer.splunk knowledge base and attempted to configure the props.conf and transforms.conf as suggested by other users. I am not achieving the results I desire. I am still indexing the CSV Header as an event when the Header should just be ignored.

My Headers include Number, Date Time, Service, Source Port, Source, Destination, Protocol

Please help if possible.

Tags (1)
0 Karma

fk319
Builder

How are you importin your CSV files, inputcsv ?


There is an option start=<int> that starts importing after <int> lines.

0 Karma

mikelanghorst
Motivator

You can simply null-queue the event with the header. Look for the section titled: "Filter event data and send to queues" here in the docs
http://www.splunk.com/base/Documentation/4.2.2/Deploy/Routeandfilterdatad

RicoSuave
Builder

I have run into the same issue. I just end up deleting that particular event. Click on the event to isolate it in the results, then just pipe it to delete:

| delete

Make sure you have the can delete role or else it wont work.

0 Karma

srsava
New Member

Thanks for your help, Although this WILL remove the Header after it is indexed, I have hundreds of CSV files I am collecting and will be indexing for this project. Can someone explain the method to remove the CSV header from being published as an event? Why does splunk assign a datetime to the CSV header?...based off the datetime the file was created? I would like to configure the Splunk instance to monitor a file location for any changes and NOT publish the CSV header as an event. I do not want to have to delete each CSV Header instance as they are indexed or perhaps re-indexed.

0 Karma
Get Updates on the Splunk Community!

Threat Hunting Unlocked: How to Uplevel Your Threat Hunting With the PEAK Framework ...

WATCH NOWAs AI starts tackling low level alerts, it's more critical than ever to uplevel your threat hunting ...

Splunk APM: New Product Features + Community Office Hours Recap!

Howdy Splunk Community! Over the past few months, we’ve had a lot going on in the world of Splunk Application ...

Index This | Forward, I’m heavy; backward, I’m not. What am I?

April 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...