Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1075

HDFSEventSink begin is called when transaction opened due to other error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.1.0
    • 1.2.0
    • Channel
    • None

    Description

      If you HDFSEvenSink is unable to close a transaction, then the next time process is called, begin is called on that same transaction and another error is thrown.

      2012-03-28 17:47:36,011 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:165)] Unhandled exception, logging and sleeping for 5000ms
      java.lang.IllegalStateException: close() called when transaction is OPEN - you must either commit or rollback first
      	at com.google.common.base.Preconditions.checkState(Preconditions.java:172)
      	at org.apache.flume.channel.BasicTransactionSemantics.close(BasicTransactionSemantics.java:179)
      	at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:381)
      	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
      	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
      	at java.lang.Thread.run(Thread.java:662)
      2012-03-28 17:47:41,013 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:374)] process failed
      java.lang.IllegalStateException: begin() called when transaction is OPEN!
      	at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
      	at org.apache.flume.channel.BasicTransactionSemantics.begin(BasicTransactionSemantics.java:131)
      	at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:323)
      	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
      	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
      	at java.lang.Thread.run(Thread.java:662)
      

      Attachments

        1. FLUME-1075.patch.2
          1 kB
          Prasad Suresh Mujumdar

        Activity

          People

            prasadm Prasad Suresh Mujumdar
            brocknoland Brock Noland
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: