Knowledge Management

Slow search for squid for a 30 days report

pinzer
Path Finder

hi all, i have a problem with a squid search, it is very very slow (over 30 minutes to load) the search is this:

sourcetype="squid" | timechart span="1d" sum(size)

the time for the search is 30 days. How can i speed this search?

the extraction field for the size parameter is

(?i)^[^/]*/\d+\s+(?P<size>[^ ]+)
0 Karma
1 Solution

dwaddle
SplunkTrust
SplunkTrust

Summary indexing is one way to speed this up. Conceptually, you tell Splunk to pre-compute this data for smaller intervals (say once per day) - and then you use that pre-computed data to complete your intended search faster.

http://www.splunk.com/base/Documentation/latest/Knowledge/Usesummaryindexing

View solution in original post

dwaddle
SplunkTrust
SplunkTrust

Summary indexing is one way to speed this up. Conceptually, you tell Splunk to pre-compute this data for smaller intervals (say once per day) - and then you use that pre-computed data to complete your intended search faster.

http://www.splunk.com/base/Documentation/latest/Knowledge/Usesummaryindexing

dwaddle
SplunkTrust
SplunkTrust

You can find information on scheduling searches in the Splunk docs at http://www.splunk.com/base/Documentation/latest/User/SchedulingSavedSearches

0 Karma

pinzer
Path Finder

how can i schedule the search every hour?

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...