Deployment Architecture

How to identify whether duplicates are happening from forwarders configuration or indexers?

PramodhKumar
Explorer

Hi Splunk Chaps,

We are having issues with a data source where events are duplicated in the cluster.
Strange that there are duplicate as well as non-duplicate events for few source types.
Also looked at index time for those duplicated events and it is exactly same for both events so not sure whether to point to forwarders configuration.

Any help would be appreciated.

Or let me know How to identify whether duplicates are happening from forwarders configuration or indexers?

Thanks
Pramodh

0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

View solution in original post

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

0 Karma

PramodhKumar
Explorer

Namaskra Giuseppe,

It seems like lissue is getting sorted, problem is with data itself has duplicates.

Regards,
Pramodh

0 Karma
Get Updates on the Splunk Community!

Get Your Exclusive Splunk Certified Cybersecurity Defense Engineer at Splunk .conf24 ...

We’re excited to announce a new Splunk certification exam being released at .conf24! If you’re headed to Vegas ...

Share Your Ideas & Meet the Lantern team at .Conf! Plus All of This Month’s New ...

Splunk Lantern is Splunk’s customer success center that provides advice from Splunk experts on valuable data ...

Combine Multiline Logs into a Single Event with SOCK: a Step-by-Step Guide for ...

Combine multiline logs into a single event with SOCK - a step-by-step guide for newbies Olga Malita The ...