Deployment Architecture

Does the Universal forwarder index events?

tim9gray
Explorer

Does the universal forwarder index events like splunk does? Here is the scenario I a curious about - if I am using Splunk with a universal forwarder(s) and I want to do a clean all to dump all my event data(this is just while I am playing around testing queries and stuff) from Splunk, will the Universal forwarder recognize this and resend the events that Splunk is now missing?

Do I have to do something similar with the Universal forwarder? If the forwarder is running on windows and as a service, how would I do this if necessary? - Would I stop the service and then run it manually with the appropriate command line arguments?

1 Solution

rturk
Builder

Hi Tim,

The Universal Forwarder does not index data, only collecting and forwarding it to an upstream indexer.

What the forwarder does do is keep track of log file events it has sent as part of the internal _fishbucket index. This keeps track of where in a log file Splunk is up to for the purposes of forwarding only new events. If you want to tell the Forwarder to send all events again, you can clean out the _fishbucket using the following command:

splunk clean eventdata _thefishbucket

Just keep in mind, this will result in duplicate data upstream if it's already been indexed.

Hope this helps 🙂

View solution in original post

rturk
Builder

Hi Tim,

The Universal Forwarder does not index data, only collecting and forwarding it to an upstream indexer.

What the forwarder does do is keep track of log file events it has sent as part of the internal _fishbucket index. This keeps track of where in a log file Splunk is up to for the purposes of forwarding only new events. If you want to tell the Forwarder to send all events again, you can clean out the _fishbucket using the following command:

splunk clean eventdata _thefishbucket

Just keep in mind, this will result in duplicate data upstream if it's already been indexed.

Hope this helps 🙂

ChrisG
Splunk Employee
Splunk Employee

Just as a reference, there is a docs topic that discusses the different types of forwarders: http://docs.splunk.com/Documentation/Splunk/5.0.4/Deploy/Typesofforwarders

Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...