Alerting

If we have an alert that tells us when a service is stopped, how can we create an alert that will also check if the service remains down?

luise
New Member

Hello,

We have an alert that tells us when a service stopped. However, the services will sometimes restart. How can we have an alert that will also check if the service remains down?

Is it possible?

Thanks,
Luis Embalo

0 Karma

sundareshr
Legend

Maybe something like this might work

index=* "success" earliest=[search index=* "failed" | timechart latest(failed) as earliest | fields earliest] | stats count 

If the count is 0 its probably because the service hasn't restarted.

0 Karma

luise
New Member

That searches for a service that is down.. what I am looking for is for way that sees the service as going down, and then keeps watching to see if it came up. If it came up, then nothing happens.. if it did not come up, then alerts.

Is that possible?

0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...