Monitoring Splunk

splunk datastore partitions - real time searches

briang67
Communicator

According to this link, it's possible to send the datastore buckets to different disk volumes to take advantage of different RAID configs.

http://wiki.splunk.com/Deploy:BucketRotationAndRetention

Which bucket is associated with realtime searches? Is it always "Hot" or is the data cached somewhere else?

We have an app that is dependent on several realtime searches and we're trying to optimize performance.

thanks

0 Karma

romantercero
Path Finder

Hi,

All I've read indicates that data hot off the indexing pipeline is put directly into the hot buckets.

yes it's possible to split an index into a location for hot-warm and cold storage. We actually do this, storing our hot/warm buckets on local drives and cold buckets on a network volume. After we did this we did see an increment in performance in terms of events per seconds read during searching and events indexed per second.

You can configure the different locations in indexes.conf like so:
[main]
homePath=/local/myindex/db
coldPath=/remote/myindex/colddb
thawedPath=/remote/myindex/thawed

Making the switch over on a live index is another issue though 😛

Good luck!

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...