Splunk Search

Splunk ES seperating source types

neely_hpe
New Member

I want to run a single search head using the ES app module. My question is I have many different log sources feeding to that search head but I want to be able to only have the ES app read events from a selected subset of log sources. Is it possible to only send various sources for ES correlation even though I have many going to the search head overall?

Thanks,

Chad

Tags (1)
0 Karma

micahkemp
Champion

Splunk ES depends heavily on the Common Information Model, which grants you some options in terms of what will be included.

There are predefined tags that are used to associate events with the datamodel it should belong to. If your sourcetypes don't set this tag, they won't be part of the datamodel. Many of the official TAs set the tags and other fields appropriately to be CIM compliant, so if you have these in place all of the events handled by those apps would already be tagged to be a part of the datamodel.

Another option is to use the CIM-provided macros to more finely tune which events should be a part of its datamodels. The macros are named cim_<datamodel>_indexes, but they are general macros and could really contain event search (you can't include |, though).

So for instance, the Web datamodel has this macro:

[cim_Web_indexes]
definition = ()

If you knew that you only wanted to include the apache sourcetype, you could set it to this:

[cim_Web_indexes]
definition = (sourcetype=apache)

Note that although I mentioned that ES relies heavily on the CIM, nothing prevents ES from using non-datamodel searches, and if you have any correlation searches that don't use the datamodel, you'd have to determine how you want to filter those when you create them. You would also need to take the sourcetypes into consideration when crafting your drilldown searches, which are almost always against raw data, which means the CIM macros wouldn't be in effect.

0 Karma
Get Updates on the Splunk Community!

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...