Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3196

Flume1.6.0 hive-sink error

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.0
    • Component/s: Sinks+Sources
    • Labels:
      None
    • Environment:

      Flume NG 1.6.0+cdh5.5.2+31
      Hadoop 2.6.0+cdh5.5.2+992
      MapReduce 1 2.6.0+cdh5.5.2+992
      HDFS 2.6.0+cdh5.5.2+992
      Hive 1.1.0+cdh5.5.2+377
      HCatalog 1.1.0+cdh5.5.2+377

      Description

      Hi,

      When use flume , source is kafka , sink is hive .
      error message like this:
      2017-11-20 17:00:49,269 ERROR org.apache.flume.SinkRunner: Unable to deliver event. Exception follows.
      org.apache.flume.EventDeliveryException: org.apache.flume.sink.hive.HiveWriter$ConnectException: Failed connecting to EndPoint

      {metaStoreUri='thrift://fonova-ahz-cdh09:9083,thrift://xxx-xxx-xxx:9083', database='aa', table='aa', partitionVals=[2017, 11, 20] }

      I have tried , also can't solve it
      1.set hive_home hcalog_home
      2.hdfs://tmp/hive and file:///tmp/hive writable (eg. chmod 777) ,
      3.set
      hive.txn.manager = org.apache.hadoop.hive.ql.lockmgr.DbTxnManager
      hive.compactor.initiator.on = true (See more important details here)
      hive.compactor.worker.threads > 0
      to hive-site.xml

      Can you give me some advice how to fix it . THKS.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                zhoubh ZHOUBEIHUA
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: