Getting Data In

forwarding too slow

crazyeva
Contributor

i let universalforwarder distribute raw data, when doing unzip work;
indexer doing sedcmd-filter, transfrom-filter work
But indexing process very slow 500events/persecond
cpu, diskio, network all at low utility
i dont know what is wrong
Can i just:
# cp /opt/splunkforwarder /opt/splunkforwarder01
# /opt/splunkforwarder01/bin/./splunk start
#
# cp /opt/splunkforwarder /opt/splunkforwarder02
# /opt/splunkforwarder02/bin/./splunk start
.....
?

0 Karma
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

I don't see any benefit in running several copies of the same forwarder on one machine.

As for forwarding speed, make sure you aren't hitting the configurable speed limiter, I believe the default is 256KB/s - if your events are 500byte on average then 500eps is about 256KB/s.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

I don't see any benefit in running several copies of the same forwarder on one machine.

As for forwarding speed, make sure you aren't hitting the configurable speed limiter, I believe the default is 256KB/s - if your events are 500byte on average then 500eps is about 256KB/s.

crazyeva
Contributor

You are quite right! maxKBps was set to 256!
Its the first time I use universalforwarder.
Thank you very much!

Get Updates on the Splunk Community!

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...