Splunk Search

How do hunk/hadoop searches work?

JohnTelus
New Member

Does, for example, hunk retrieve all the data from the hadoop path, move it to a temporary location, apply the search criteria, and then return the results to the user?

Tags (3)
0 Karma

Ledion_Bitincka
Splunk Employee
Splunk Employee

rdagan_splunk
Splunk Employee
Splunk Employee

Hunk converts the search into Hadoop MR Job. With virtual indexes, Hunk can access subset of the data. Hunk leverages the MapReduce framework to execute report-generating searches and Indexing on Hadoop nodes. Data does not need to be pre-processed before it is accessed because Hunk lets you run analytics searches against the data where it rests in Hadoop. In addition, Data Preview for Exploration is done by allowing Hunk to look at subset of the data after each phase of the MR Job.

Get Updates on the Splunk Community!

More Ways To Control Your Costs With Archived Metrics | Register for Tech Talk

Tuesday, May 14, 2024  |  11AM PT / 2PM ET Register to Attend Join us for this Tech Talk and learn how to ...

.conf24 | Personalize your .conf experience with Learning Paths!

Personalize your .conf24 Experience Learning paths allow you to level up your skill sets and dive deeper ...

Threat Hunting Unlocked: How to Uplevel Your Threat Hunting With the PEAK Framework ...

WATCH NOWAs AI starts tackling low level alerts, it's more critical than ever to uplevel your threat hunting ...