Getting Data In

How to control splunk logs splunkd_stderr.log & splunkd-utility.log filling up disk space

anantdeshpande
Path Finder

Hi,
I have installed Splunk having very limited space. I am able to manage other logs my modifying /etc/log.cfg file.
However, do not find any parameter to rotate/control splunkd_stderr.log & splunkd-utility.log.

Do we have any separate parameter/file to manage these Splunk logs?

Tags (1)
0 Karma

ddrillic
Ultra Champion

For this specific index you can allocate (a lot) less than the 1/2 terabyte assigned, by default, for each index.

To begin with, you can run the following to know how much each index consumes -

| rest /services/data/indexes 
| eval perc=(currentDBSizeMB * 100 / maxTotalDataSizeMB ) 
| table title currentDBSizeMB maxTotalDataSizeMB perc

bpitts2
Path Finder

I downvoted this post because this is a completely irrelevant answer.

0 Karma

ddrillic
Ultra Champion

Oh oh - really sorry ; -) but truly it's really relevant.

0 Karma

lukejadamec
Super Champion

I agree. What is the point of decreasing the size of the log files if they are all indexed with a max size of 1/2 TB anyway?

0 Karma

bpitts2
Path Finder

Hello,

As you mentioned most logs can be controlled from /etc/log.cfg, however there are some logs such as splunkd_stderr.log that are effectively "hard coded" and cannot be changed. However, it was suggested that you could use a symbolic link to move the files to your preferred location.

Reference:
https://answers.splunk.com/answers/9879/possible-to-move-splunks-log-folder-splunk-home-var-log-splu...

Best Regards,
BPitts2

0 Karma

anantdeshpande
Path Finder

Thank you,
As last solution will write script or create symbolic link.

0 Karma

anantdeshpande
Path Finder

Looks like we can manage splunkd-utility.log by changing parameter in log-utility.cfg.
Any how its 5 MB and will limit to 1 rotation than 5.

appender.A1.fileName=${SPLUNK_HOME}/var/log/splunk/splunkd-utility.log

appender.A1.maxFileSize=5000000 # default: 5MB (specified in bytes).

appender.A1.maxBackupIndex=5

bpitts2
Path Finder

Good to know, thanks!

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...