When I try to push to my hadoop cluster I get the following error which appears to be permissions related. Can someone help me to resolve the issue?
Failed to create cursor file: hdfs://10.144.64.195:8020/datasift_sample/9c6abd2095cd036a1d82834c234e5c65.1349092800.cursor.0. touchz: `hdfs://10.144.64.195:8020/datasift_sample/9c6abd2095cd036a1d82834c234e5c65.1349092800.cursor.0': No such file or directory
You should give permissions to root like following.
# su hdfs
$ hadoop fs -chmod 777 /datashift_sample
# exit
Try it.
Does the Splunk system user have write permission on your Hadoop cluster? You can easily test this from the CLI using the following:
Looks like the splunk user doesn't have permissions. Can you show me how to add?
ip-10-83-86-58:/apps/hadoop/bin # ./hadoop fs -touchz hdfs://10.144.64.195:8020/test/foo.txt
touchz: `hdfs://10.144.64.195:8020/test/foo.txt': No such file or directory
ip-10-83-86-58:/apps/hadoop/bin # ./hadoop fs -touchz hdfs://10.144.64.195:8020/foo.txt
touchz: Permission denied: user=root, access=WRITE, inode="/":hdfs:supergroup:drwxr-xr-x
ip-10-83-86-58:/apps/hadoop/bin # ./hadoop fs -touchz hdfs://10.144.64.195:8020/test/foo.txt