Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-543

TailThread exits on repeated WAL failures

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.9.3
    • Fix Version/s: 0.9.5
    • Component/s: Sinks+Sources
    • Labels:
      None
    • Environment:

      Amazon EC2 Ubuntu 10.04 LTS

      Description

      On repeated failures:

      2011-02-28 23:37:26,908 ERROR com.cloudera.flume.core.connector.DirectDriver: Driving src/sink failed! LazyOpenSource | LazyOpenDecorator because java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
      java.io.IOException: java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
      	at com.cloudera.flume.agent.durability.NaiveFileWALDeco$1.fireError(NaiveFileWALDeco.java:254)
      	at com.cloudera.flume.core.connector.DirectDriver.fireError(DirectDriver.java:216)
      	at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:102)
      Caused by: java.lang.IllegalStateException: Expected state to be LOGGED but was SENT
      	at com.google.common.base.Preconditions.checkState(Preconditions.java:145)
      	at com.cloudera.flume.agent.durability.NaiveFileWALManager.changeState(NaiveFileWALManager.java:410)
      	at com.cloudera.flume.agent.durability.NaiveFileWALManager.getUnackedSource(NaiveFileWALManager.java:557)
      	at com.cloudera.flume.agent.durability.WALSource.next(WALSource.java:104)
      	at com.cloudera.flume.core.connector.DirectDriver$PumperThread.run(DirectDriver.java:89)
      

      The tailer exits and the master reports all nodes in ERROR state.

      2011-02-28 23:37:27,917 INFO com.cloudera.flume.handlers.text.TailSource: TailThread has exited
      

      Full log file attached.

      Rob

        Attachments

        1. ASF.LICENSE.NOT.GRANTED--FLUME-543.log
          1.02 MB
          Disabled imported user

          Issue Links

            Activity

              People

              • Assignee:
                jmhsieh Jonathan Hsieh
                Reporter:
                flume_robert.slifka@gmail.com Disabled imported user
              • Votes:
                9 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: