All Apps and Add-ons

Splunk Add-on for Kafka: Does managing inputs manually from each Heavy Forwarder create duplicates?

Harishma
Communicator

I have two Heavy Forwarders configured with the Splunk Add-on for Kafka. Now if I manually create input topic messages from each forwarder, won't that become a duplicate?
I wanna maintain a balanced topic load between these two forwarders? How do I achieve this?

Sorry if my doubts seem naive, cos I'm just trying a POC on Kafka-Splunk connect.

0 Karma

rpille_splunk
Splunk Employee
Splunk Employee

Hi Harishma,

Yes, it is possible to accidentally create duplicates using this manual method, so when you select the topics to collect on each forwarder, you have to ensure that you don't collect the same topics from more than one forwarder.

The documentation for the steps to follow is here: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_manu...

If you want instead to have the topic collection split up over several heavy forwarders automatically, use this method instead: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_cent...

Get Updates on the Splunk Community!

Stay Connected: Your Guide to May Tech Talks, Office Hours, and Webinars!

Take a look below to explore our upcoming Community Office Hours, Tech Talks, and Webinars this month. This ...

They're back! Join the SplunkTrust and MVP at .conf24

With our highly anticipated annual conference, .conf, comes the fez-wearers you can trust! The SplunkTrust, as ...

Enterprise Security Content Update (ESCU) | New Releases

Last month, the Splunk Threat Research Team had two releases of new security content via the Enterprise ...