Splunk Search

How to obtain x% of the data

flora123
Path Finder

hello!

I want to know whether I can get 10% of the data?

...| eventstats count | eval ten_p=floor(count*0.1) | head ten_p...

BUT!

Error in 'head' command: The argument must be a positive number or a boolean expression.

Some people know how to obtain this information?
Thanks a lot.m(_ _)m

Tags (2)
0 Karma
1 Solution

sideview
SplunkTrust
SplunkTrust

You can use the head command with a boolean expression, and it will allow the streaming search to continue until the boolean expression returns false. This can be a neat trick especially when you can have it entirely in the streaming portion of the search, because you can get far fewer events off disk sometimes.

In this particular case though, the eventstats command is going to run through the entire search and so when the head command terminates it, it'll be too late to avoid getting all the events off disk.

Anyway, it would look more like this:

... | streamstats count as thisRowCount | eventstats count as totalCount | head thisRowCount<totalCount/10 

View solution in original post

sideview
SplunkTrust
SplunkTrust

You can use the head command with a boolean expression, and it will allow the streaming search to continue until the boolean expression returns false. This can be a neat trick especially when you can have it entirely in the streaming portion of the search, because you can get far fewer events off disk sometimes.

In this particular case though, the eventstats command is going to run through the entire search and so when the head command terminates it, it'll be too late to avoid getting all the events off disk.

Anyway, it would look more like this:

... | streamstats count as thisRowCount | eventstats count as totalCount | head thisRowCount<totalCount/10 
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...

What's new in Splunk Cloud Platform 9.1.2312?

Hi Splunky people! We are excited to share the newest updates in Splunk Cloud Platform 9.1.2312! Analysts can ...

What’s New in Splunk Security Essentials 3.8.0?

Splunk Security Essentials (SSE) is an app that can amplify the power of your existing Splunk Cloud Platform, ...