Splunk Search

When does the accelerated Data model's values get processed to tsidx?

clyde772
Communicator

Hey Experts!

We have a debate going on about when splunk punches in the field values when the data model acceleration is enabled. 2 ideas,

  1. The accelerated field values gets processed (put into tsidx) when the data gets indexed into an index.
  2. The accelerated field values gets processed (put into tsidx) when a user accesses a data model. Once the data model in accessed the processed values remains for the other users.

Which one is right? Also lookup, geo tag, regex attributes also gets put into accelerated tsidx?

Cheer~! Thanks for sharing your knowledge with people in need~!

Tags (3)
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

If you're talking about persistent acceleration, number 1 is more correct - every few minutes splunk will accelerate recently indexed data on the indexers.
If you're talking about ad-hoc acceleration when you did not explicitly enable acceleration for this datamodel, number 2 is more correct - when you run a pivot, temporary acceleration happens on the search head for your second run in that pivot editor session. However, other users don't benefit from this because it's only temporary to your dispatch directory.

More info on that here: http://docs.splunk.com/Documentation/Splunk/latest/Knowledge/Acceleratedatamodels

Concerning your other types of fields, I'm not certain. For lookups and geoinformation I'm guessing no, because those use external sources that may change without splunk knowing. For regex I'm guessing yes, because those don't change on their own. However, that's just my gut talking.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

If you're talking about persistent acceleration, number 1 is more correct - every few minutes splunk will accelerate recently indexed data on the indexers.
If you're talking about ad-hoc acceleration when you did not explicitly enable acceleration for this datamodel, number 2 is more correct - when you run a pivot, temporary acceleration happens on the search head for your second run in that pivot editor session. However, other users don't benefit from this because it's only temporary to your dispatch directory.

More info on that here: http://docs.splunk.com/Documentation/Splunk/latest/Knowledge/Acceleratedatamodels

Concerning your other types of fields, I'm not certain. For lookups and geoinformation I'm guessing no, because those use external sources that may change without splunk knowing. For regex I'm guessing yes, because those don't change on their own. However, that's just my gut talking.

tchen_splunk
Splunk Employee
Splunk Employee

I believe the geo-ip data is baked into the data model acceleration.

http://docs.splunk.com/Documentation/Splunk/6.2.0/Knowledge/AddageoIPattribute
Note: Geo IP attributes are added to your object as required attributes, and their Type values are predetermined. You cannot change these values.

0 Karma

clyde772
Communicator

Martin, Appreciate your answer! Every few minutes? I verified I was able to get values for tstat up to the very second of current time. That means it would rather immdiately as the data gets indexed, wouldn't you think? This data model could be used very well to cover up Splunk regular data call speeds.

0 Karma
Get Updates on the Splunk Community!

Detecting Remote Code Executions With the Splunk Threat Research Team

REGISTER NOWRemote code execution (RCE) vulnerabilities pose a significant risk to organizations. If ...

Observability | Use Synthetic Monitoring for Website Metadata Verification

If you are on Splunk Observability Cloud, you may already have Synthetic Monitoringin your observability ...

More Ways To Control Your Costs With Archived Metrics | Register for Tech Talk

Tuesday, May 14, 2024  |  11AM PT / 2PM ET Register to Attend Join us for this Tech Talk and learn how to ...