Getting Data In

how to setup forwarder to ingest logs from a specific date / last day's log and carry on monitoring the future files as they are created?

shivarpith
Path Finder

i am dealing with a imilar issue, i am trying to ingest webserver logs and the historical log data in webserver is huge and brought splunk down when i tried to ingest. i want splunk UF to start from the latest or the day before's log file and ingest the new log files that are created in future

Example:
exclude logs till march 27th.
ingest march 28th.log
march 29th.log
march 30th.log
march 31th.log
april 1st.log

.
.
.
.
.
and all log files post march 28th ( normal splunk UF behaviour)

can i use current_only=1 setting or any other suggested recommendation.

Hope i was clear enough. Thanks in advance

0 Karma

martin_mueller
SplunkTrust
SplunkTrust

You can set ignoreOlderThan=3d in inputs.conf to do just that, ignore files older than three days or whatever time span you like.

ddrillic
Ultra Champion

Just came across the ignoreOlderThan topic at https://answers.splunk.com/topics/ignoreolderthan.html.

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...