Splunk Search

when executing an external lookup, does splunk execute it on all nodes or just on the search head?

whisperstream
Explorer

I have a set of log data that contains user_ids, and want to do a lookup to resolve the user_id to an email address. I have an external look that can programmatically resolve each user's id, but am wondering (assuming I have a 4 node cluster) if splunk will execute 4 instances of the lookup script in parallel or if it only launches one (or if it's configurable?)

Tags (2)
0 Karma
1 Solution

woodcock
Esteemed Legend

Normally, Splunk sends the lookup file from the Search Head in the bundle replication process to the Indexers and the lookups are done there. However, you can force the lookups to be done on the search head with the local=true:

Syntax: local=<bool>
Description: If local=true, forces the lookup to run on the search head and not on any remote peers.

Obviously, this can very drastically impact performance because some of the normally-reduced job may now have to be done on the Search Head.

View solution in original post

0 Karma

woodcock
Esteemed Legend

Normally, Splunk sends the lookup file from the Search Head in the bundle replication process to the Indexers and the lookups are done there. However, you can force the lookups to be done on the search head with the local=true:

Syntax: local=<bool>
Description: If local=true, forces the lookup to run on the search head and not on any remote peers.

Obviously, this can very drastically impact performance because some of the normally-reduced job may now have to be done on the Search Head.

0 Karma

whisperstream
Explorer

Thanks for that "bundle replication" was the keyword I was looking for, for others interested I also found this link: http://docs.splunk.com/Documentation/Splunk/6.2.4/DistSearch/Mounttheknowledgebundle

0 Karma
Get Updates on the Splunk Community!

Wondering How to Build Resiliency in the Cloud?

IT leaders are choosing Splunk Cloud as an ideal cloud transformation platform to drive business resilience,  ...

Updated Data Management and AWS GDI Inventory in Splunk Observability

We’re making some changes to Data Management and Infrastructure Inventory for AWS. The Data Management page, ...

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...