Getting Data In

Moving data in indexers (clustered environment) to frozen bucket

cirkit1
Explorer

Have a clustered environment of 3 indexers. Data in the indexers was used to test full architecture capability.

dont need the data anymore in the indexers as would like to start off with clean slate on indexers.

Would like to move existing data to a frozen bucket, as we been told repeatedly it is not a good idea to delete indexer data.

Looking for recommendation on best path and feasibility.

Tags (3)

lguinn2
Legend

You could do it this way:

  1. Make sure that no inputs.conf is sending data to that index. Generally, it is okay to downsize an index while it is still being used, but the settings you will use here are pretty extreme. And you are deleting the index in the last step.
  2. Make sure that you have specified a coldToFrozenDir - it can be anywhere that you like
  3. Set the frozenTimePeriodInSecs to a small value like 86400 (1 day).
  4. Wait until the time period is up.
  5. Use this search | dbinspect index=yourindex span=7d to check that you do not have any buckets with data in them. You should still have hot buckets, but the event count should be zero.
  6. Archive everything in the frozen directory.
  7. Delete the directory containing the index (its location is specified in indexes.conf)
  8. Delete the index stanza from indexes.conf.

    [yourindex]
    ...
    frozenTimePeriodInSecs=86400
    coldToFrozenDir=/tmp/directoryforfrozenbuckets

Get Updates on the Splunk Community!

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...

Built-in Service Level Objectives Management to Bridge the Gap Between Service & ...

Wednesday, May 29, 2024  |  11AM PST / 2PM ESTRegister now and join us to learn more about how you can ...

Get Your Exclusive Splunk Certified Cybersecurity Defense Engineer Certification at ...

We’re excited to announce a new Splunk certification exam being released at .conf24! If you’re headed to Vegas ...