Splunk Dev

During custom application upgrades, is there a configuration to limit what files or directories to update?

cmutt78
Explorer

I have a custom application that does incremental loads from an external resource. I maintain a file with the latest timestamps so that each run I can read the file and pull the new data. My struggle is with how do I perform application upgrades without rolling these files back to their initial value. Is there a configuration that can be set to ignore file types or directories during a custom application upgrade?

Please advise.

0 Karma

alacercogitatus
SplunkTrust
SplunkTrust

The "modular input way", which I also would suggest for other types of inputs, is to use the "checkpoint_dir" configuration. When A modular input is created, it is assigned a special checkpoint directory to store such files that keep checkpoints. Each file contains whatever information is needed for the input (either a single timestamp, or perhaps a json object with a more complex status). The location for modular input is /opt/splunk/var/lib/splunk/modinputs/$INPUTNAME. This will do a few things for you:

  1. Remove dependency on default and local configs. You could remove the entire App, reinstall, and as long as the script looks in the checkpoint dir, you are fine.
  2. A consistent place to put the files, and won't (read shouldn't) break across Splunk upgrades.

As always, you can contact me directly via email, IRC (#splunk on EfNet), or just shouting at the screen (ok, maybe not that one).

0 Karma

richgalloway
SplunkTrust
SplunkTrust

If you put your timestamp file in the 'local' directory, it won't be affected by upgrades. Apps should not deliver a 'local' directory.

---
If this reply helps you, Karma would be appreciated.
0 Karma
Get Updates on the Splunk Community!

Built-in Service Level Objectives Management to Bridge the Gap Between Service & ...

Wednesday, May 29, 2024  |  11AM PST / 2PM ESTRegister now and join us to learn more about how you can ...

Get Your Exclusive Splunk Certified Cybersecurity Defense Engineer at Splunk .conf24 ...

We’re excited to announce a new Splunk certification exam being released at .conf24! If you’re headed to Vegas ...

Share Your Ideas & Meet the Lantern team at .Conf! Plus All of This Month’s New ...

Splunk Lantern is Splunk’s customer success center that provides advice from Splunk experts on valuable data ...