Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3088

Flume channel failed to initialize log replay

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.4.0
    • 1.4.0
    • Channel
    • Pivotal HD 2.0.1.0,Hadoop v.2.2,Flume 1.4.0

    Description

      Before this issue came up I found an issue with protobuf-java version is not in sync with hadoop protobuf-java version so I moved the one from flume directory.Later, I configured my sources.type=spooldir and channels.type=memory and sink.type as HDFS it worked fine.Now when I tried with channels.type=file and I configured its checkpointdirs and datadirs it gives me an error saying (From log)

      27 Apr 2017 07:47:51,901 ERROR [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.Log.replay:476) - Failed to initialize Log on [channel=chan1]
      java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
      at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
      at org.apache.flume.channel.file.proto.ProtosFactory$Checkpoint.getSerializedSize(ProtosFactory.java:233)
      at com.google.protobuf.AbstractMessageLite.writeDelimitedTo(AbstractMessageLite.java:84)
      at org.apache.flume.channel.file.EventQueueBackingStoreFileV3.<init>(EventQueueBackingStoreFileV3.java:111)
      at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:70)
      at org.apache.flume.channel.file.Log.replay(Log.java:412)
      at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:302)
      at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)
      27 Apr 2017 07:47:51,904 ERROR [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.FileChannel.start:313) - Failed to start the file channel [channel=chan1]
      java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
      at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
      at org.apache.flume.channel.file.proto.ProtosFactory$Checkpoint.getSerializedSize(ProtosFactory.java:233)
      at com.google.protobuf.AbstractMessageLite.writeDelimitedTo(AbstractMessageLite.java:84)
      at org.apache.flume.channel.file.EventQueueBackingStoreFileV3.<init>(EventQueueBackingStoreFileV3.java:111)
      at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:70)
      at org.apache.flume.channel.file.Log.replay(Log.java:412)
      at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:302)
      at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)

      I don't know where I am wrong is it versioning problem.Please help on this.

      Attachments

        Activity

          People

            Unassigned Unassigned
            kalyanv56@gmail.com sri kalyan kasyap vundrakonda
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified