Getting Data In

Moving data in indexers (clustered environment) to frozen bucket

cirkit1
Explorer

Have a clustered environment of 3 indexers. Data in the indexers was used to test full architecture capability.

dont need the data anymore in the indexers as would like to start off with clean slate on indexers.

Would like to move existing data to a frozen bucket, as we been told repeatedly it is not a good idea to delete indexer data.

Looking for recommendation on best path and feasibility.

Tags (3)

lguinn2
Legend

You could do it this way:

  1. Make sure that no inputs.conf is sending data to that index. Generally, it is okay to downsize an index while it is still being used, but the settings you will use here are pretty extreme. And you are deleting the index in the last step.
  2. Make sure that you have specified a coldToFrozenDir - it can be anywhere that you like
  3. Set the frozenTimePeriodInSecs to a small value like 86400 (1 day).
  4. Wait until the time period is up.
  5. Use this search | dbinspect index=yourindex span=7d to check that you do not have any buckets with data in them. You should still have hot buckets, but the event count should be zero.
  6. Archive everything in the frozen directory.
  7. Delete the directory containing the index (its location is specified in indexes.conf)
  8. Delete the index stanza from indexes.conf.

    [yourindex]
    ...
    frozenTimePeriodInSecs=86400
    coldToFrozenDir=/tmp/directoryforfrozenbuckets

Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...