Getting Data In

Best Practise: Different Log Sources

FRoth
Contributor

How do you handle different source types?

Do you create an index for every type of source i.e. an index called "unix" for all the logs coming from Linux, Solaris and Unix systems and an index "windows" for all Windows clients an servers.

That was my first impulse ...

Or do you receive everything into a "main" index and separate everything in the searches by appropriate search statements?

0 Karma
1 Solution

gkanapathy
Splunk Employee
Splunk Employee

Generally, put things in the same index unless you have a specific reason to do otherwise and understand how any why you would want it. The general reasons might include:

  • Differential data retention
  • Access control
  • Performance

Note that while the above are possible reasons or concerns, it doesn't mean that simply using more indexes is a solution, e.g., putting every single source into a different index will often make performance worse, or might make it better.

View solution in original post

0 Karma

gkanapathy
Splunk Employee
Splunk Employee

Generally, put things in the same index unless you have a specific reason to do otherwise and understand how any why you would want it. The general reasons might include:

  • Differential data retention
  • Access control
  • Performance

Note that while the above are possible reasons or concerns, it doesn't mean that simply using more indexes is a solution, e.g., putting every single source into a different index will often make performance worse, or might make it better.

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...