Splunk Enterprise Security

How to Separate data from main index/HF?

Zacknoid
Explorer

Hello everyone, 
I am trying to separate data getting into the main index from particular hosts. I am trying 

Transforms.conf
[windows_ot]
DEST_KEY = _metadata_index
Regex = HOst123
Format = host_wineventlog
Source_key = Metadata:Host

Props.conf
[wineventlog]
Transforms-setindex = windows_ot

Do we have another way to separate 26 host's data ( without accessing the host machines ) 
The following data flow level 2 (Heavyforwarder) sending data to ---> level 3 (heavy forwarder) ---> main HF
Is it a way to separate data in the main HF ?? also is trans conf correct ?? 

Labels (2)
0 Karma
1 Solution

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

View solution in original post

Zacknoid
Explorer

We're using intermediate forwarders to send data from one level to another, as in between there are firewall and communication though one HF to another HF on another level. 
we're collecting all data from UF's and using HF to push it to another level with all firewall rules and policies.

I am trying with DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

Do you have any document link referring to the same ? | THANKS

0 Karma

isoutamo
SplunkTrust
SplunkTrust

Hi

KEYS: describe those Meta keys.

If you have to use intermediate forwarders then can you use UF instead of HFs? Basically only reason to use HF is need for python or some other data manipulation tasks inside forwarder. If possible try to decrease the levels of IHFs anyway. And when you have IHFs or IUFs in use you should have several of those in every network/security segments.

r. Ismo

richgalloway
SplunkTrust
SplunkTrust

The correct value for DEST_KEY is  _MetaData:Index .  Use upper case on the left side of the = in transforms.conf.

The transforms must be on the first heavy forwarder through which the data passes.

Why do you have intermediate forwarders (IFs)?  Why multiple layers of IFs?  Why are you using HFs instead of UFs for the IFs?  IFs add complexity and can impede performance

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

Stay Connected: Your Guide to May Tech Talks, Office Hours, and Webinars!

Take a look below to explore our upcoming Community Office Hours, Tech Talks, and Webinars this month. This ...

They're back! Join the SplunkTrust and MVP at .conf24

With our highly anticipated annual conference, .conf, comes the fez-wearers you can trust! The SplunkTrust, as ...

Enterprise Security Content Update (ESCU) | New Releases

Last month, the Splunk Threat Research Team had two releases of new security content via the Enterprise ...