Hadoop YARN
  1. Hadoop YARN
  2. YARN-212

NM state machine ignores an APPLICATION_CONTAINER_FINISHED event when it shouldn't

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.4, 2.0.1-alpha
    • Fix Version/s: 2.0.3-alpha, 0.23.5
    • Component/s: nodemanager
    • Labels:
      None

      Description

      The NM state machines can make the following two invalid state transitions when a speculative attempt is killed shortly after it gets started. When this happens the NM keeps the log aggregation context open for this application and therefore chews up FDs and leases on the NN, eventually running the NN out of FDs and bringing down the entire cluster.

      2012-11-07 05:36:33,774 [AsyncDispatcher event handler] WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Can't handle this event at current state
      org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: APPLICATION_CONTAINER_FINISHED at INITING

      2012-11-07 05:36:33,775 [AsyncDispatcher event handler] WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Can't handle this event at current state: Current: [DONE], eventType: [INIT_CONTAINER]
      org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: INIT_CONTAINER at DONE

      1. yarn-212.txt
        11 kB
        Nathan Roberts
      2. yarn-212.txt
        10 kB
        Nathan Roberts

        Issue Links

          Activity

          Nathan Roberts created issue -
          Nathan Roberts made changes -
          Field Original Value New Value
          Attachment yarn-212.txt [ 12553256 ]
          Nathan Roberts made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 2.0.1-alpha [ 12323270 ]
          Nathan Roberts made changes -
          Attachment yarn-212.txt [ 12553260 ]
          Jason Lowe made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 2.0.3-alpha [ 12323272 ]
          Fix Version/s 0.23.5 [ 12323311 ]
          Resolution Fixed [ 1 ]
          Thomas Graves made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Jason Lowe made changes -
          Link This issue is duplicated by YARN-346 [ YARN-346 ]

            People

            • Assignee:
              Nathan Roberts
              Reporter:
              Nathan Roberts
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development