All Apps and Add-ons

Is the Hunk App for HBase compatible with HBase version 1.1.1.2, or do I have to be on 1.1.2?

Moonveil
Explorer

Hello,

Does the Hunk App for HBase also work with version 1.1.1.2 of HBase? Or do I have to be on 1.1.2?

Thank you!

Tags (2)
0 Karma

jruaux_splunk
Splunk Employee
Splunk Employee

Yes this should work. Here is a link to the HBase version compatibility matrix: https://hbase.apache.org/book.html#hbase.versioning
The line of interest here is the "Client-Server wire Compatibility", which indicates that a 1.1.2 client (the Hunk App for HBase) can talk to a 1.1.1.2 server.

0 Karma

Moonveil
Explorer

Hmm, I've installed the app, but am not getting any results. I'm seeing lots of errors being thrown when I inspect the search log in Hunk after setting loglevel to DEBUG.

Does this app support vix.zookeeper.znode.parent = /hbase-secure? We're using Kerberos to secure hdfs and hbase. That's the only difference I see from the tutorial example.

Thank you.

Edit - I've included some of the errors that I'm seeing in the search log below:

11-01-2016 16:36:26.225 ERROR ERP.hbase -  {"action":"search","conf":{"provider":{"dfs.namenode. ...{skipping 22392 bytes}... server\""}]}]}}}
11-01-2016 16:36:26.455 ERROR ERP.hbase -  Handling deprecation for all properties in config...
11-01-2016 16:36:26.456 ERROR ERP.hbase -  Handling deprecation for hbase.auth.token.max.lifetime
...
11-01-2016 16:22:07.772 ERROR ERP.hbase -  hbase.online.schema.update.enabletruehbase-default.xml
11-01-2016 16:22:07.772 ERROR ERP.hbase -  hbase.table.lock.enabletruehbase-default.xml
11-01-2016 16:22:07.772 ERROR ERP.hbase -  hbase.master.port16000hbase-default.xml
...
11-01-2016 16:36:26.671 ERROR ERP.hbase -  field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.682 ERROR ERP.hbase -  field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.682 ERROR ERP.hbase -  field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, value=[GetGroups], about=, type=DEFAULT, always=false, sampleName=Ops)
11-01-2016 16:36:26.683 ERROR ERP.hbase -  UgiMetrics, User and group related metrics
11-01-2016 16:36:26.902 ERROR ERP.hbase -   Creating new Groups object
11-01-2016 16:36:26.904 ERROR ERP.hbase -  Trying to load the custom-built native-hadoop library...
11-01-2016 16:36:26.904 ERROR ERP.hbase -  Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
11-01-2016 16:36:26.904 ERROR ERP.hbase -  java.library.path=/var/data/splunk/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
11-01-2016 16:36:26.905 ERROR ERP.hbase -  Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
11-01-2016 16:36:26.905 ERROR ERP.hbase -  Falling back to shell based
11-01-2016 16:36:26.905 ERROR ERP.hbase -  Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
11-01-2016 16:36:26.918 ERROR ERP.hbase -  setsid exited with exit code 0
11-01-2016 16:36:26.918 ERROR ERP.hbase -  Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
11-01-2016 16:36:26.925 ERROR ERP.hbase -  hadoop login
11-01-2016 16:36:26.926 ERROR ERP.hbase -  hadoop login commit
11-01-2016 16:36:26.929 ERROR ERP.hbase -  using local user:UnixPrincipal: root
11-01-2016 16:36:26.930 ERROR ERP.hbase -  UGI loginUser:root (auth:SIMPLE)
11-01-2016 16:36:27.145 ERROR ERP.hbase -  Process identifier=hconnection-0x7c0e4e8c connecting to ZooKeeper ensemble=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100
...
11-01-2016 16:36:27.155 ERROR ERP.hbase -  Initiating client connection, connectString=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100 sessionTimeout=90000 watcher=hconnection-0x7c0e4e8c0x0, quorum=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100, baseZNode=/hbase-secure
11-01-2016 16:36:27.159 ERROR ERP.hbase -  zookeeper.disableAutoWatchReset is false
11-01-2016 16:36:27.181 ERROR ERP.hbase -  Opening socket connection to server ser2.hd.tel.com/192.168.1.12:2100. Will not attempt to authenticate using SASL (unknown error)
11-01-2016 16:36:27.188 ERROR ERP.hbase -  Socket connection established to ser2.hd.tel.com/192.168.1.12:2100, initiating session
11-01-2016 16:36:27.189 ERROR ERP.hbase -  Session establishment request sent on ser2.hd.tel.com/192.168.1.12:2100
11-01-2016 16:36:27.194 ERROR ERP.hbase -  Session establishment complete on server ser2.hd.tel.com/192.168.1.12:2100, sessionid = 0x35808b91ead65aa, negotiated timeout = 40000
11-01-2016 16:36:27.196 ERROR ERP.hbase -  hconnection-0x7c0e4e8c0x0, quorum=ser1.hd.tel.com:2100,ser2.hd.tel.com:2100,ser3.hd.tel.com:2100, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null
11-01-2016 16:36:27.198 ERROR ERP.hbase -  hconnection-0x7c0e4e8c-0x35808b91ead65aa connected
11-01-2016 16:36:27.200 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 1,3  replyHeader:: 1,1413045927159,0  request:: '/hbase-secure/hbaseid,F  response:: s{601295421767,1413045908958,1450390354271,1478040387927,39,0,0,0,67,0,601295421767} 
11-01-2016 16:36:27.204 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 2,4  replyHeader:: 2,1413045927159,0  request:: '/hbase-secure/hbaseid,F  response:: #ffffffff000146d61737465723a3136303030ffffffbaffffffdc4fffffff93fffffff9ffffffc3ffffffecffffff9f50425546a2432633833323230312d643239652d346133392d616635662d323037313831306639323736,s{601295421767,1413045908958,1450390354271,1478040387927,39,0,0,0,67,0,601295421767} 
11-01-2016 16:36:27.336 ERROR ERP.hbase -  Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@659cc1d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
11-01-2016 16:36:27.342 ERROR ERP.hbase -  Getting table 'hbase_table' and column family '*'
11-01-2016 16:36:27.358 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 3,3  replyHeader:: 3,1413045927161,0  request:: '/hbase-secure,F  response:: s{601295421598,601295421598,1450390322736,1450390322736,0,164,0,0,0,18,1413045909076} 
11-01-2016 16:36:27.362 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 4,4  replyHeader:: 4,1413045927161,0  request:: '/hbase-secure/master,F  response:: #ffffffff000146d61737465723a3136303030ffffff9bffffffd07afffffffb177b4e6150425546a28a1c6d6173746572312e6861646f6f702e74736c2e74656c75732e636f6d10ffffff807d18fffffff4ffffffbcffffffc9ffffff90ffffff822b10018ffffff8a7d,s{1413045908941,1413045908941,1478040386375,1478040386375,0,0,0,96836983061353612,76,0,1413045908941} 
11-01-2016 16:36:27.539 ERROR ERP.hbase -  Use SIMPLE authentication for service MasterService, sasl=false
11-01-2016 16:36:27.556 ERROR ERP.hbase -  Connecting to ser1.hd.tel.com/192.171.1.10:16000
11-01-2016 16:36:27.768 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 5,3  replyHeader:: 5,1413045927162,0  request:: '/hbase-secure,F  response:: s{601295421598,601295421598,1450390322736,1450390322736,0,164,0,0,0,18,1413045909076} 
11-01-2016 16:36:27.771 ERROR ERP.hbase -  Reading reply sessionid:0x35808b91ead65aa, packet:: clientPath:null serverPath:null finished:false header:: 6,4  replyHeader:: 6,1413045927162,0  request:: '/hbase-secure/master,F  response:: #ffffffff000146d61737465723a3136303030ffffff9bffffffd07afffffffb177b4e6150425546a28a1c6d6173746572312e6861646f6f702e74736c2e74656c75732e636f6d10ffffff807d18fffffff4ffffffbcffffffc9ffffff90ffffff822b10018ffffff8a7d,s{1413045908941,1413045908941,1478040386375,1478040386375,0,0,0,96836983061353612,76,0,1413045908941} 
...
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:147)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at org.apache.hadoop.hbase.client.HTable.executeMasterCallable(HTable.java:603)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at org.apache.hadoop.hbase.client.HTable.getTableDescriptor(HTable.java:579)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at com.splunk.erp.hbase.HBaseERP.scan(HBaseERP.java:190)
11-01-2016 16:45:18.279 ERROR ERP.hbase -   at com.splunk.erp.hbase.HBaseERP.main(HBaseERP.java:350)
11-01-2016 16:45:18.279 ERROR ERP.hbase -  Caused by: org.apache.hadoop.hbase.MasterNotRunningException: com.google.protobuf.ServiceException: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: IPC Client (2026433662) connection to ser1.hd.tel.com/192.171.1.10:16000 from root is closing
0 Karma
Get Updates on the Splunk Community!

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...