All Apps and Add-ons

Microsoft Log Analytics Add-on : How do I use the checkpointing feature?

althomas
Communicator

Hi all,

I've installed https://splunkbase.splunk.com/app/4127/ in order to pull some required data out of Log Analytics and into Splunk.

When setting up an input, there is a "Start Date" which implies that checkpointing is used in this app, but the only documentation I can find for this is as follows:

01/01/1970 00:00:00
Start date must be in the format of dd/mm/yyyy hh:mm:ss

In the DB Connect app, this is done by a ? in the query, but I don't know how this will be used when producing a query for Log Analytics.

Any and all help would be greatly appreciated.

Best regards,
Alex

1 Solution

nickhills
Ultra Champion

Hi @althomas!

Having looked at the code, the TA seems to create/update a checkpoint each time it iterates through the data collection.

This checkpoint date is used as the starting point on subsequent queries, but in the case that this is the first run it will override the (non-existent) checkpoint value with the value defined in your inputs.conf

if helper.get_check_point(input_name):
    start_datetime = datetime.datetime.strptime(helper.get_check_point(input_name),'%d/%m/%Y %H:%M:%S')
else:
    start_datetime = datetime.datetime.strptime(str(input_item['start_date']),'%d/%m/%Y %H:%M:%S')
If my comment helps, please give it a thumbs up!

View solution in original post

nickhills
Ultra Champion

Hi @althomas!

Having looked at the code, the TA seems to create/update a checkpoint each time it iterates through the data collection.

This checkpoint date is used as the starting point on subsequent queries, but in the case that this is the first run it will override the (non-existent) checkpoint value with the value defined in your inputs.conf

if helper.get_check_point(input_name):
    start_datetime = datetime.datetime.strptime(helper.get_check_point(input_name),'%d/%m/%Y %H:%M:%S')
else:
    start_datetime = datetime.datetime.strptime(str(input_item['start_date']),'%d/%m/%Y %H:%M:%S')
If my comment helps, please give it a thumbs up!
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...