I am trying to have LB setup to send large volume of data into 4 different INDEXES in round robin structure.
But when I set up the forwarder LB, the forwarder sends exact duplicate copies of data into 4 of those indexers instead of scattering the data amongst the indexers.
So 100G sent from forwarder, 100G shows up on each indexers, instead of 25G per indexers. How can I setup forwarder to load 100G of data into 4 indexer consuming 25G on each indexers.
Here is my outputs.conf following the docementation. Am I missing any tricks?
================ outputs.conf =====================
[tcpout:10.150.206.29_9997]
disabled=false
autoLB = true
autoLBFrequency=40
server = 10.150.206.29:9997
[tcpout:10.150.233.4_9997]
disabled=false
autoLB = true
autoLBFrequency=40
server = 10.150.233.4:9997
[tcpout:10.154.39.173_9997]
disabled=false
autoLB = true
autoLBFrequency=40
server = 10.154.39.173:9997
[tcpout:10.150.201.29_9997]
disabled=false
autoLB = true
autoLBFrequency=40
server = 10.150.201.29:9997
[tcpout]
defaultGroup = 10.150.206.29_9997,10.150.233.4_9997,10.154.39.173_9997,10.150.201.29_9997
=====================================================
I think of it this way: each stanza sets up a duplicate output stream. So what you need is:
[tcpout]
defaultGroup = my_indexers
[tcpout:my_indexers]
disabled=false
autoLB = true
autoLBFrequency=40
server = 10.150.206.29:9997,10.150.233.4:9997,10.154.39.173:9997,10.150.201.29:9997
And it's shorter, too!