Knowledge Management

Can I increase the number of backfill threads higher than 16

approachct
Path Finder

Is there a way to increase the number of maximum threads that the backfill script will use to a value higher than 16?

Tags (1)
0 Karma

gkanapathy
Splunk Employee
Splunk Employee

You could simply edit or copy and edit the fill_summary_index.py script by hand. However, you will still be limited by settings for the max number of concurrent search jobs in the Splunk server set in limits.conf. These vary depending on the number of CPU cores you have and by default is 4+(4*n_cores), but you can edit these parameters as well. If your machine has

  • More than 16 CPU cores, and
  • Pretty high disk IOPs

you can get through the jobs faster. Otherwise, you'll bottleneck on one of these resources.

Get Updates on the Splunk Community!

Index This | Forward, I’m heavy; backward, I’m not. What am I?

April 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

A Guide To Cloud Migration Success

As enterprises’ rapid expansion to the cloud continues, IT leaders are continuously looking for ways to focus ...

Join Us for Splunk University and Get Your Bootcamp Game On!

If you know, you know! Splunk University is the vibe this summer so register today for bootcamps galore ...