Getting Data In

How to load data into multiple indexes based on the event data?

khreddy777
New Member

Can I dynamically assign index value at the indexer level to the events based on the data and load the data into the right index?
For example:
1,A,200
2,A,300
3,B,200
4,B,300
5,C,500
6,C,300

I have created three indexes indexA, indexB, indexC
I want to load the data into indexA,indexB,indexC based on the second column.

After data is loaded:
in IndexA I should have
1,A,200
2,A,300

in indexB I should have
3,B,200
4,B,300

in indexC I should have
5,C,500
6,C,300

0 Karma

neelshah
Path Finder

You may do this by using props.conf and transforms.conf.

-----------------props.conf---------------------

[index_A]
TRANSFORMS-filter_A_events= filter_A_events

[index_B]
TRANSFORMS-filter_B_events= filter_B_events

[index_C]

TRANSFORMS-filter_C_events= filter_C_events

----------Transforms.conf--------------------------

[filter_A_events]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue

[filter_B_events]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue

[filter_C_events]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue


If you are using HF to forward events, place these .conf files on HF.
If you are using UF for forward events, place these .conf files on Indexer

Hope this helps ...!!!

0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...