I'm having trouble getting the Hunk App for AWS ELB working. The error shown in the Hunk App is:
[elb_log_provider] Error while running external process, return_code=255. See search.log for more info
[elb_log_provider] RuntimeException - Failed to create a virtual index filesystem connection: Server IPC version 9 cannot communicate with client version 4. Advice: Verify that your vix.fs.default.name is correct and available.
Here's what I've done so far:
Created by EMR cluster for analyzing
ELB Access logs exactly per Amazon's tutorial.
Launched an instance
of the Hunk AMI from the Amazon
Marketplace.
Logged into the splunk
app at http://{public ip}:8000/ and
changed my password. SCP
splunk-6.0.2-196940-Linux-x86_64.tgz
to /opt/splunk_packages Logged into
the instance and updated splunk as
follows:
sudo /opt/splunk/bin/splunk stop
sudo tar -xvzf splunk-6.0.2-196940-Linux-x86_64.tgz -C /opt
sudo /opt/splunk/bin/splunk start --accept-license --answer-yes
Logged into splunk app at http://{public
ip}:8000/ and uploaded the Hunk app from
a file.
Updated the Hunk app per the in-app docs.
On This step I was undlear on the part to "Change the HDFS working directory attribute to reflect a read/writable HDFS path in your cluster." So it's likely I didn't get this correct. I created /hunk/working-dir/ on the local file system of all EMR nodes.
In my Amazon security groups
for the EMR master and slave, I
opened up all TCP, UDP, and ICMP from
the Hunk instance to the EMR
instances.
Can someone please advise on the next steps to troubleshoot?
Thanks!
... View more