Flume
  1. Flume
  2. FLUME-1075

HDFSEventSink begin is called when transaction opened due to other error

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.1.0
    • Fix Version/s: v1.2.0
    • Component/s: Channel
    • Labels:
      None

      Description

      If you HDFSEvenSink is unable to close a transaction, then the next time process is called, begin is called on that same transaction and another error is thrown.

      2012-03-28 17:47:36,011 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:165)] Unhandled exception, logging and sleeping for 5000ms
      java.lang.IllegalStateException: close() called when transaction is OPEN - you must either commit or rollback first
      	at com.google.common.base.Preconditions.checkState(Preconditions.java:172)
      	at org.apache.flume.channel.BasicTransactionSemantics.close(BasicTransactionSemantics.java:179)
      	at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:381)
      	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
      	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
      	at java.lang.Thread.run(Thread.java:662)
      2012-03-28 17:47:41,013 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:374)] process failed
      java.lang.IllegalStateException: begin() called when transaction is OPEN!
      	at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
      	at org.apache.flume.channel.BasicTransactionSemantics.begin(BasicTransactionSemantics.java:131)
      	at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:323)
      	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
      	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
      	at java.lang.Thread.run(Thread.java:662)
      
      1. FLUME-1075.patch.2
        1 kB
        Prasad Mujumdar

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Prasad Mujumdar
            Reporter:
            Brock Noland
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development