Deployment Architecture

Archiving speed is very very slow

sudhir7
Explorer

I tried to archive data by adding frozenTimePeriodInSecs and coldToFrozenDir settings for individual indexes in local/indexes.conf.
We have 10TB of data to be archive but the rate of archiving was very very slow around 1GB/day.
Has anyone else faced a similar situation ?

0 Karma

Elsurion
Communicator

Your whole index is 10TB and a the day to freeze is how many GB?
My system here is freezing about 10GB/day, but only because the events should be frozen. The Index is about 1TB.
Also the discs are not highspeed just a bunch of normal discs.

0 Karma

sudhir7
Explorer

Hi Elsurion,
Thanks for your reply.
We are using SATA disk, could that be the reason for slowness ?

0 Karma

Elsurion
Communicator

I don't think so. Unless you have just one disc which is used for others as well and not a whole cabinet.
But you could run bonnie++ to check your filesystem for benchmark issues.

0 Karma
Get Updates on the Splunk Community!

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...

Get the T-shirt to Prove You Survived Splunk University Bootcamp

As if Splunk University, in Las Vegas, in-person, with three days of bootcamps and labs weren’t enough, now ...

Wondering How to Build Resiliency in the Cloud?

IT leaders are choosing Splunk Cloud as an ideal cloud transformation platform to drive business resilience,  ...