Getting Data In

If I have an application writing the same logs to two servers, can we run a forwarder on both and configure an indexer to only index events from one?

shailesh030
Path Finder

I have an application which writes the same log to two servers. They act as each other's backup during maintenance schedules. We plan to run a forwarder on both the log servers. Is it possible to configure a Splunk indexer in such a way that it will index the events from only one source & ignore the other? This will ensure that when one of the servers is under maintenance, events from the 2nd server keep getting processed, ensuring no interruption to Splunk monitoring.

0 Karma

jensonthottian
Contributor

There is a crazy solution I can think of :

Lets say we have 2 servers : Server 1 and Server 2, both having cloned logs.
Create a script in Server 2 to the outputs.conf to start forwarding when Server 1 is under maintenance(no heartbeat), as soon as you get a heartbeat for Server1 the script will in the outputs.conf in Server2.

So this script should reside on Server 2 and should have the below capabilities:
1. Should be able to check heartbeat of Server1
2. Should be able to make edit outputs.conf of Server2

FritzWittwer_ol
Contributor

smart solution 🙂 depending on the requirements the split brain situation (communication loss between the two servers) has to taken into account.

0 Karma

FritzWittwer_ol
Contributor

why do you wane filter out this events at index time, not just during search time be removing duplicates. You would need some logic to decide from which node you have to disable the events.

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...