All Apps and Add-ons

How to configure AMQP Messaging Modular Input to poll more than one queue from RabbitMQ and the frequency?

mmisciagna_splu
Splunk Employee
Splunk Employee

Hello!

We need some help with the AMPQ TA and RabbitMQ. We have data being polled from a single queue and need the TA to pull from more and at a greater rate.

In this case, the RabbitMQ has six messaging queues. We are only polling one and at a very low rate. We are unsure of the performance of the messaging modular input, however, we do know that we are not collecting all events from the single queue.

The questions are:

What setting need to be added to allow the TA to pull from more then one queue?
How can I increase the polling interval and data set size?

Any help is appreciated!

0 Karma

Damien_Dallimor
Ultra Champion

1) to setup multiple queues is easy. Just setup more stanzas , 1 stanza = 1 queue. They will all run as individual threads in the same JVM.

2) on scale , without scientific metrics to go off to give you accurate advice , I would suggest reading this blog in the first instance. Also this presentation , particularly from slide 20 might be of interest as on older alternative way to scale out.

0 Karma
Get Updates on the Splunk Community!

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...