Hello,
I got a partitionned Hive table by field dt (in the YYYYMMDD format)
Example :
/mywarehouse/my.db/foo/dt=20160207/part-m-00000
I got a Hunk Index on top of that :
[foo]
vix.provider = my_hive_provider
vix.input.1.path = /mywarehouse/my.db/foo/...
vix.input.1.splitter.hive.dbname = my
vix.input.1.splitter.hive.tablename = foo
vix.input.1.splitter.hive.fileformat = orc
The problem is, when I select a date from the timepicker, I would like Hunk to go directly to the dt partition (because now it makes a full scan of the DB)
I try to modify the following:
vix.input.1.path = /mywarehouse/my.db/foo/${dt}/...
and to add in props.conf :
[foo]
TIME_PREFIX="dt":
TIME_FORMAT = %Y%m%d
[source::.../mywarehouse/my.db/foo/*/*]
sourcetype = foo
But none of it matter...
Could someone lend me a hand on that?
Thanks
... View more