Getting Data In

Minimize Size of Logs being processed??

stevehoweuk
New Member

I have splunk free installed and want to log some remote server but the Security Log is hogging my 500MB daily allowance I am using remote agents, is there a way to only index aspects of the security Log in splunk? Obviously I don't at the moment care about succesful logins and log outs ets

Tags (1)
0 Karma

Drainy
Champion

Ok. So I will assume you are monitoring entire directories at the moment and pulling all logs in.
There is something called a nullQueue in splunk, when an event arrives it goes through several stages of parsing and queues before eventually being indexed. Just before it arrives at the index you can filter off certain events into a "nullQueue". These do not get indexed and simply get written away.

Have a read of;
http://docs.splunk.com/Documentation/Splunk/latest/Deploy/Routeandfilterdatad#Filter_event_data_and_...

If you have any problems then just update your question with anything you've tried and the community can help troubleshoot it further.

0 Karma
Get Updates on the Splunk Community!

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...