Flume
  1. Flume
  2. FLUME-1771

JDBCChannel does not work with FlumeAvroEvent Serializer

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      2012-12-04 14:24:25,111 (lifecycleSupervisor-1-4) [INFO - org.apache.flume.sink.RollingFileSink.start(RollingFileSink.java:135)] RollingFileSink fileSink-1 started.
      2012-12-04 14:24:25,145 (lifecycleSupervisor-1-2) [INFO - org.apache.flume.source.NetcatSource.start(NetcatSource.java:164)] Created serverSocket:sun.nio.ch.ServerSocketChannelImpl[/127.0.0.1:33333]
      2012-12-04 14:24:25,593 (SinkRunner-PollingRunner-DefaultSinkProcessor) [WARN - org.apache.flume.channel.jdbc.impl.JdbcTransactionImpl.rollback(JdbcTransactionImpl.java:102)] Marking transaction for rollback
      2012-12-04 14:24:25,594 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.channel.jdbc.impl.JdbcTransactionImpl.close(JdbcTransactionImpl.java:118)] Attempting transaction roll-back
      2012-12-04 14:24:25,604 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:160)] Unable to deliver event. Exception follows.
      org.apache.flume.EventDeliveryException: Failed to process transaction
              at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:218)
              at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
              at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
              at java.lang.Thread.run(Thread.java:722)
      Caused by: org.apache.avro.file.DataFileWriter$AppendWriteException: java.lang.ClassCastException: java.util.ArrayList cannot be cast to java.util.Map
              at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:263)
              at org.apache.flume.serialization.AbstractAvroEventSerializer.write(AbstractAvroEventSerializer.java:108)
              at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:195)
              ... 3 more
      Caused by: java.lang.ClassCastException: java.util.ArrayList cannot be cast to java.util.Map
              at org.apache.avro.generic.GenericDatumWriter.getMapSize(GenericDatumWriter.java:174)
              at org.apache.avro.generic.GenericDatumWriter.writeMap(GenericDatumWriter.java:159)
              at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:68)
              at org.apache.avro.reflect.ReflectDatumWriter.write(ReflectDatumWriter.java:104)
              at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:105)
              at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:65)
              at org.apache.avro.reflect.ReflectDatumWriter.write(ReflectDatumWriter.java:104)
              at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:57)
              at org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:257)
              ... 5 more
      

        Activity

        Brock Noland created issue -
        Ashish Paliwal made changes -
        Field Original Value New Value
        Assignee Ashish Paliwal [ paliwalashish ]

          People

          • Assignee:
            Ashish Paliwal
            Reporter:
            Brock Noland
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development