Splunk Search

how to count rows with lack of field !

ashishv
Explorer

so i have a log which has column/field which will be populated with "Y" if there is an ERROR, feild name is ERROR_FLAG and will be blank if there is no ERROR.

how do i calculate rows where this FIELD is non-existant or blank ?

alternatively, how do i subtract ERROR_FEILD="Y" Count from Total Row count to get me this data.. all has to be done in real time.

Tags (1)
1 Solution

Ron_Naken
Splunk Employee
Splunk Employee

Calculating non-existent or blank can be done like this:

... NOT ERROR_FLAG=*

To count the rows where the field is not Y, including blank or missing:

... NOT ERROR_FLAG="Y" | stats count

NOTE: Using "<field>!=<value>" will not account for missing or empty fields. You should use the "NOT <field>=<value>" syntax.

View solution in original post

Ron_Naken
Splunk Employee
Splunk Employee

Calculating non-existent or blank can be done like this:

... NOT ERROR_FLAG=*

To count the rows where the field is not Y, including blank or missing:

... NOT ERROR_FLAG="Y" | stats count

NOTE: Using "<field>!=<value>" will not account for missing or empty fields. You should use the "NOT <field>=<value>" syntax.

jrodman
Splunk Employee
Splunk Employee

Not-Exist OR blank is a bit tricky. Try

(ERROR="" OR NOT ERROR="*")
0 Karma

jrodman
Splunk Employee
Splunk Employee

Oh, Ayn's solution is superior if it is really precisely as you describe.

0 Karma

Ayn
Legend

I think it will be easier to answer your question if you can provide us with some sample events. Once you have a working field extraction, the rest should pose no problems. If you've successfully extracted the field using name "error_field" for instance, you would just have to do

error_field!="Y"

I'm unsure what you mean by that it has to be done in real time. The field extractions will work on any search, regardless of what time range you choose (including real-time).

Ayn
Legend

I stand corrected. Thanks!

0 Karma

Ron_Naken
Splunk Employee
Splunk Employee

This method will not account for blank values or a missing field. See my answer to account for these.

0 Karma
Get Updates on the Splunk Community!

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...