Splunk Search

Comparing two consecutive events

Parse
New Member

Hello all,

I am trying to evaluate my process using two consecutive events and know whether my process succeeded or failed. My log is set up as below:
1. When process is started, I get - #Timestamp# Started MyProcess
2. When process is completed successfully, I get - #Timestamp# Completed MyProcess
3. If it fails, I get - #Timestamp# Terminated MyProcess

The process usually takes a minute or so. I would like to query and find out whether the process has succeeded or failed and also, how long it took. For the immediate (my process runs many times in a day and so I need to compare only the immediate/ consecutive entries) combination of Started and Completed, the status should be success, whereas for Started and Terminated, the status should be Failed.

My base query is like:
index=myIndex sourcetype = applogs "Started MyProcess " Or "Completed MyProcess" Or "Terminated MyProcess"

Any help would be highly appreciated! Thanks much!

Cheers!

PS

0 Karma

martin_mueller
SplunkTrust
SplunkTrust

I'm assuming you have the name of the process extracted into a process field, and that there are no overlapping instances of any one process.

  index=myIndex sourcetype=applogs process=* (Started OR Completed OR Terminated)
| transaction process startswith=Started endswith=(Completed OR Terminated)

Mild disclaimer: Didn't test if the endswith condition is correct syntax, see http://docs.splunk.com/Documentation/Splunk/6.4.3/SearchReference/Transaction to make it work for your specific events.

That will stitch together the start and end events, and give you a duration field per process run. By examining the events for "Completed" or "Terminated" you can tell if the run was successful or not.

If the assumption of "no overlapping runs" does not hold you need unique IDs to link each start and end event together, and run the transaction command on that ID field.

0 Karma
Get Updates on the Splunk Community!

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...