Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3089

flume hive sink

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None
    • system:Ubuntu 16.04.1 LTS \n \l
      flume:apache-flume-1.7.0-bin.tar.gz
      hive:apache-hive-2.1.1-bin

    Description

      When flume is running up,the background is being given:
      2017-05-06 21:17:19,544 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
      org.apache.flume.EventDeliveryException: java.lang.IllegalArgumentException
      at org.apache.flume.sink.hive.HiveSink.process(HiveSink.java:267)
      at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
      at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IllegalArgumentException
      at java.sql.Date.valueOf(Date.java:143)
      at org.apache.hive.hcatalog.data.JsonSerDe.extractCurrentField(JsonSerDe.java:310)
      at org.apache.hive.hcatalog.data.JsonSerDe.populateRecord(JsonSerDe.java:218)
      at org.apache.hive.hcatalog.data.JsonSerDe.deserialize(JsonSerDe.java:174)
      at org.apache.hive.hcatalog.streaming.StrictJsonWriter.encode(StrictJsonWriter.java:156)
      at org.apache.hive.hcatalog.streaming.StrictJsonWriter.write(StrictJsonWriter.java:123)
      at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.writeImpl(HiveEndPoint.java:815)
      at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:782)
      at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:735)
      at org.apache.flume.sink.hive.HiveJsonSerializer.write(HiveJsonSerializer.java:42)
      at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:158)
      at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:152)
      at org.apache.flume.sink.hive.HiveWriter$11.call(HiveWriter.java:428)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      ... 1 more

      I do not know why,please help me,thanks.

      Attachments

        Activity

          People

            Unassigned Unassigned
            mengge mengge zhang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: