I'm using Splunk Add-on for Kafka to collect data from a Kafka cluster, I believe the configs are OK because data is coming, but the transmission speed is very low, about 200 msg/min (the transmission speed into Kafka is about 1000 msg/min), but once in an hour or two, there are 20k msg/min for 1-2 minutes. The Kafka cluster is on the same machine, so I think network won't be a problem. I have repeated the same configuration on 3 different machines, and the same thing happens, what could've caused this issue?
... View more