All Apps and Add-ons

Failed to start MapReduce job. Please consult search.log

Ledion_Bitincka
Splunk Employee
Splunk Employee

Running into an issue with Hunk against our Kerberized, YARN cluster. The Hunk principal auth works fine, what ends up happening is that a search will kick off, start searching thru events returns some results and previews: but after running over ~1 minute, it dies with:

01-27-2014 18:56:39.021 ERROR ERP.redacted-provider -  UserGroupInformation - PriviledgedActionException 
as:hunk@REDACTED.COM (auth:KERBEROS) cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - UNKNOWN_SERVER)]

the following error message is thrown in the UI too

[redacted-provider] JobStartException - Failed to start MapReduce job. Please consult search.log for more information. Message: [ Failed to start MapReduce job, name=SPLK_search1.dev.hunk.redacted.com_1390848963.3_0 ] and [ null ]

Any pointers would be appreciated

Tags (3)
0 Karma
1 Solution

Ledion_Bitincka
Splunk Employee
Splunk Employee

The root cause of the above problem was a typo in the service principal specification for the resourcemananager principal

vix.yarn.resourcemanager.principal = yarn/namenode.redacted.com@REDACTED.COM

a change to the generic/wildcard principal specification fixed the issue

vix.yarn.resourcemanager.principal = yarn/_HOST@REDACTED.COM

View solution in original post

0 Karma

Ledion_Bitincka
Splunk Employee
Splunk Employee

The root cause of the above problem was a typo in the service principal specification for the resourcemananager principal

vix.yarn.resourcemanager.principal = yarn/namenode.redacted.com@REDACTED.COM

a change to the generic/wildcard principal specification fixed the issue

vix.yarn.resourcemanager.principal = yarn/_HOST@REDACTED.COM
0 Karma
Get Updates on the Splunk Community!

Index This | I’m short for "configuration file.” What am I?

May 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with a Special ...

New Articles from Academic Learning Partners, Help Expand Lantern’s Use Case Library, ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Your Guide to SPL2 at .conf24!

So, you’re headed to .conf24? You’re in for a good time. Las Vegas weather is just *chef’s kiss* beautiful in ...