Getting Data In

Universal Forwarder stop Forwarding

jeanfrederic
New Member

Im using Splunk Cloud,

and every once in a while, im getting this error

05-13-2015 09:10:34.891 -0400 WARN TcpOutputProc - Forwarding to indexer group splunkcloud blocked for 207000 seconds.

After that, my indexer is not indexing anymore.
Inside the log, I continue to see thing like this :

05-13-2015 09:07:16.757 -0400 WARN TcpOutputProc - Possible duplication of events with channel=source::WMI:AllReplicatedFolder|host::server1|WMI:AllReplicatedFolder|53003616, streamId=12722903640634641263, offset=516887 subOffset=1 on host=54.174.234.168:9997
05-13-2015 09:07:16.757 -0400 WARN TcpOutputProc - Possible duplication of events with channel=source::WMI:AllReplicatedFolder|host::server1|WMI:AllReplicatedFolder|53003616, streamId=12722903640634641263, offset=298120 subOffset=1 on host=54.174.234.168:9997

So I guess the forwarder continue to gather informations from differents servers.

I have to restart the service to make the cloud index again.

This universal forwarder is making WMI request to 30 differents server and push information to the cloud.
I have the exact same wmi.conf file on a "local test machine" wich is splunk enterprise 6.2.2 and it never stoped to index the same information.

Any one have the solution ? Thanks

0 Karma

jeanfrederic
New Member

For some reason, It turned to be my Universal Forwarder that was sending "duplicate" by itself.

My Splunk Enterprise Index was all right, around 2200 entries... and My Splunk Cloud was having 1 200 000 entries.
They both use the same wmi.conf

I dont know why I was having those duplicate.

0 Karma

Stefan
Explorer

How did you set your forwarder? Using a Deployment Manager?

Also what O/S is it running on? I've seen some similar behaviour on Windows forwarders in the past.

0 Karma
Get Updates on the Splunk Community!

Stay Connected: Your Guide to May Tech Talks, Office Hours, and Webinars!

Take a look below to explore our upcoming Community Office Hours, Tech Talks, and Webinars this month. This ...

They're back! Join the SplunkTrust and MVP at .conf24

With our highly anticipated annual conference, .conf, comes the fez-wearers you can trust! The SplunkTrust, as ...

Enterprise Security Content Update (ESCU) | New Releases

Last month, the Splunk Threat Research Team had two releases of new security content via the Enterprise ...