Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1592

Vertex should wait for all initializers to finish before moving to INITED state

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.5.1
    • None
    • None
    • Reviewed

    Description

      Reported by vikram.dixit

      When using multiple initializers, the following stack trace is seen at times.

      2014-09-17 15:05:00,406 ERROR [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Can't handle Invalid event V_ROOT_INPUT_INITIALIZED on vertex Map 2 with vertexId vertex_1410991351910_0002_8_01 at current state RUNNING
      org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_ROOT_INPUT_INITIALIZED at RUNNING
        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
        at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1337)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:168)
        at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1641)
        at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1627)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:173)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:106)
        at java.lang.Thread.run(Thread.java:662)
      

      Attachments

        1. TezChild3Jstack.txt
          10 kB
          Vikram Dixit K
        2. TezChild2Jstack.txt
          10 kB
          Vikram Dixit K
        3. TezChild1Jstack.txt
          7 kB
          Vikram Dixit K
        4. DagAppMasterJstack.txt
          47 kB
          Vikram Dixit K
        5. TEZ-1592.1.txt
          11 kB
          Siddharth Seth

        Activity

          People

            sseth Siddharth Seth
            sseth Siddharth Seth
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: