Getting Data In

How do disk space issues occur in Splunk indexers and what are the options to troubleshoot or prevent this from happening?

Kaushikkatta03
Explorer

I was trying to figure it out how disk space issues occur in the indexers and what are the possible outcomes to get on from it?

0 Karma
1 Solution

renjith_nair
Legend

Splunk Enterprise stores all of the data it processes in indexes. An index is a collection of databases, which are subdirectories located in $SPLUNK_HOME/var/lib/splunk. Indexes consist of two types of files: rawdata files and index files.

Splunk does compression of data when it's writing to the disk However, the more you store, the more disk space will be used.

You can implement data retention in splunk using bucket rolling (internal splunk mechanism) . Below link will give you an idea about how the index and bucket works.

https://wiki.splunk.com/Deploy:BucketRotationAndRetention

As mentioned in the link, you can change parameters in the indexes.conf to adjust data retension.

http://docs.splunk.com/Documentation/Splunk/6.3.3/Admin/Indexesconf

Happy Splunking!

View solution in original post

renjith_nair
Legend

Splunk Enterprise stores all of the data it processes in indexes. An index is a collection of databases, which are subdirectories located in $SPLUNK_HOME/var/lib/splunk. Indexes consist of two types of files: rawdata files and index files.

Splunk does compression of data when it's writing to the disk However, the more you store, the more disk space will be used.

You can implement data retention in splunk using bucket rolling (internal splunk mechanism) . Below link will give you an idea about how the index and bucket works.

https://wiki.splunk.com/Deploy:BucketRotationAndRetention

As mentioned in the link, you can change parameters in the indexes.conf to adjust data retension.

http://docs.splunk.com/Documentation/Splunk/6.3.3/Admin/Indexesconf

Happy Splunking!
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...