Getting Data In

Trying to properly format a blacklist for imported files.

mpresseau
New Member

I have configured multiple Data Inputs, pointing at folders such as /mnt/DataInput1 etc. There is a lot of noise so tried following the following links to add a blacklist to the inputs.conf for the input, to restrict junk data such as Level=INFO type linux data.
https://docs.splunk.com/Documentation/Splunk/latest/Data/Whitelistorblacklistspecificincomingdata?r=...

Example input:
[monitor:///mnt/blob/XXXXXXXXXX/logs]
disabled = false
index = customer_XXXX_XXXXXXXX
blacklist = Level="(INFO)"

Unfortunately after several tries, and after making a change, restarting Splunk to see the change, then waiting several hours for the Data Inputs page to queue up the number of files, it still doesn't work.

Can anyone please shed some insight into what I'm doing wrong please?
Ultimately I'd like to do something like:

blacklist = Level="(INFO)"|coderef="(salt*)|"consul)"

Where as you can see above, I want to blacklist =different event types.

Help?

Labels (1)
0 Karma

richgalloway
SplunkTrust
SplunkTrust

That's not what blacklisting does. The blacklist feature in a monitor statement tells Splunk to ignore any file that matches the given expression. It's often used to skip .gz files, for example.

Filtering certain events within a file is a different feature, which is implemented using transforms. See https://answers.splunk.com/answers/719162/how-do-i-use-propsconf-and-transformsconf-to-filte.html

---
If this reply helps you, Karma would be appreciated.
0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...