All Apps and Add-ons

After setting up Hortonworks Sandbox 2.1 and installing Hunk 6.2, why are Hunk jobs not getting finalized (YARN HDP 2.x)?

hRun
Path Finder

I recently set up a Hortonworks Sandbox 2.1 in VirtualBox and installed Hunk 6.2 for some lab testing.
As the heading already says, when I start a search, it won't finalize. Hunk tells me x of y events matched and then gets stuck.
I configured my provider according to what Hue and the yarn-site.xml told me and none of the previous questions referring to the same issue helped me.
My search.log gives me 2 errors, I don't understand:

 1. java.lang.RuntimeException: Parent search is done. Alive token file does not exist: /opt/hunk/var/run/splunk/dispatch/subsearch_1422460645.44_1422461000.3/alive.token
 2. java.lang.RuntimeException: Parent search is done. Found file: /opt/hunk/var/run/splunk/dispatch/1422460645.44/finalize

http://pastebin.com/Ys93VTYL

Tags (3)
0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

View solution in original post

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

hRun
Path Finder

I already figured it out this morning, when suddenly a "OutOfMemory" exception appeared instead which was way more helpful. Allocating more memory by modifying yarn-site.xml and mapred-site.xml solved the problem.

Get Updates on the Splunk Community!

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...