All Apps and Add-ons

After setting up Hortonworks Sandbox 2.1 and installing Hunk 6.2, why are Hunk jobs not getting finalized (YARN HDP 2.x)?

hRun
Path Finder

I recently set up a Hortonworks Sandbox 2.1 in VirtualBox and installed Hunk 6.2 for some lab testing.
As the heading already says, when I start a search, it won't finalize. Hunk tells me x of y events matched and then gets stuck.
I configured my provider according to what Hue and the yarn-site.xml told me and none of the previous questions referring to the same issue helped me.
My search.log gives me 2 errors, I don't understand:

 1. java.lang.RuntimeException: Parent search is done. Alive token file does not exist: /opt/hunk/var/run/splunk/dispatch/subsearch_1422460645.44_1422461000.3/alive.token
 2. java.lang.RuntimeException: Parent search is done. Found file: /opt/hunk/var/run/splunk/dispatch/1422460645.44/finalize

http://pastebin.com/Ys93VTYL

Tags (3)
0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

View solution in original post

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

hRun
Path Finder

I already figured it out this morning, when suddenly a "OutOfMemory" exception appeared instead which was way more helpful. Allocating more memory by modifying yarn-site.xml and mapred-site.xml solved the problem.

Get Updates on the Splunk Community!

What's new in Splunk Cloud Platform 9.1.2312?

Hi Splunky people! We are excited to share the newest updates in Splunk Cloud Platform 9.1.2312! Analysts can ...

What’s New in Splunk Security Essentials 3.8.0?

Splunk Security Essentials (SSE) is an app that can amplify the power of your existing Splunk Cloud Platform, ...

Let’s Get You Certified – Vegas-Style at .conf24

Are you ready to level up your Splunk game? Then, let’s get you certified live at .conf24 – our annual user ...