Getting Data In

Minimize Size of Logs being processed??

stevehoweuk
New Member

I have splunk free installed and want to log some remote server but the Security Log is hogging my 500MB daily allowance I am using remote agents, is there a way to only index aspects of the security Log in splunk? Obviously I don't at the moment care about succesful logins and log outs ets

Tags (1)
0 Karma

Drainy
Champion

Ok. So I will assume you are monitoring entire directories at the moment and pulling all logs in.
There is something called a nullQueue in splunk, when an event arrives it goes through several stages of parsing and queues before eventually being indexed. Just before it arrives at the index you can filter off certain events into a "nullQueue". These do not get indexed and simply get written away.

Have a read of;
http://docs.splunk.com/Documentation/Splunk/latest/Deploy/Routeandfilterdatad#Filter_event_data_and_...

If you have any problems then just update your question with anything you've tried and the community can help troubleshoot it further.

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...