Knowledge Management

[smartstore] Is it feasible to merge to separate smart-store. indexer into one?

rbal_splunk
Splunk Employee
Splunk Employee

I am curious if this may be possible:

2 indexer clusters which are using separate smart-store. Customer want to combine the 2 environments into a single indexer cluster.
- Both environments are on same splunk version 7.2.4.2
- Both use multi-site configuration with 3 sites each.
- One environment is 126 indexer and another is 18 indexer. Both environments has its own cluster master.
- Both environments have different index names expect for internal indexes.
Any idea?
3 replies

Tags (1)
0 Karma

rbal_splunk
Splunk Employee
Splunk Employee

It is possible, but operationally non-trivial.

Probably best approach would be (moving from cluster1 to cluster2) :
1) Stop ingest on cluster1
2) Roll all Splunk buckets on cluster 1, make sure they upload
3) Copy all Splunk buckets from cluster1's s3 location to cluster2's
4) Bootstrap cluster2

0 Karma

wkpatrickdeutsc
Engager

Is there any clarity on step 4. Like how to bootstrap one cluster2 with cluster 1's data. Or is all that is needed it to make the buckets available in the smartstore bucket?

0 Karma

esix_splunk
Splunk Employee
Splunk Employee

As stated, this should work. Much in a similar way as local storage would work, and similar caveats apply..

I'll add one more thought to this. The copy from Cluster 1's object store will need to be done outside of Splunk. So you'll have to rely on either AWS tools, or your storage admin's capabilities to copy from cluster1's s3 bucket to cluster2's bucket. Obviously you'll need to be considerate of potential name space collisions..

0 Karma

rbal_splunk
Splunk Employee
Splunk Employee

Thanks for elaborating further.

0 Karma

srajarat2
Path Finder

Alternatively, you can set up a new bucket for the second environment on the first S3 object store, replicate the data from the second S3 object store to first (assuming they are on similar object stores with replication enabled), include the new bucket under a new volume in indexes.conf.

0 Karma
Get Updates on the Splunk Community!

Updated Team Landing Page in Splunk Observability

We’re making some changes to the team landing page in Splunk Observability, based on your feedback. The ...

New! Splunk Observability Search Enhancements for Splunk APM Services/Traces and ...

Regardless of where you are in Splunk Observability, you can search for relevant APM targets including service ...

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...