[FLUME-3196] Flume1.6.0 hive-sink error

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: Sinks+Sources

Environment

Flume NG 1.6.0+cdh5.5.2+31
Hadoop 2.6.0+cdh5.5.2+992
MapReduce 1 2.6.0+cdh5.5.2+992
HDFS 2.6.0+cdh5.5.2+992
Hive 1.1.0+cdh5.5.2+377
HCatalog 1.1.0+cdh5.5.2+377

• Assignee: Unassigned
• Reporter: ZHOUBEIHUA
• Created: 20/Nov/17 09:34
• Updated: 21/Nov/17 06:44
• Resolved: 21/Nov/17 06:44

Description

Hi,

When use flume , source is kafka , sink is hive .
error message like this:
2017-11-20 17:00:49,269 ERROR org.apache.flume.SinkRunner: Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: org.apache.flume.sink.hive.HiveWriter$ConnectException: Failed connecting to EndPoint

{metaStoreUri='thrift://fonova-ahz-cdh09:9083,thrift://xxx-xxx-xxx:9083', database='aa', table='aa', partitionVals=[2017, 11, 20] }

I have tried , also can't solve it
1.set hive_home hcalog_home
2.hdfs://tmp/hive and file:///tmp/hive writable (eg. chmod 777) ,
3.set
hive.txn.manager = org.apache.hadoop.hive.ql.lockmgr.DbTxnManager
hive.compactor.initiator.on = true (See more important details here)
hive.compactor.worker.threads > 0
to hive-site.xml

Can you give me some advice how to fix it . THKS.

Issue Links

• Blocked: FLUME-2433 Add kerberos support for Hive sink