Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-4171

DAGImp::getDAGStatus should try to report RUNNING state information correctly

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.0, 0.9.3
    • None
    • None

    Description

      https://github.com/apache/tez/blob/master/tez-dag/src/main/java/org/apache/tez/dag/app/dag/impl/DAGImpl.java#L593

       

      https://github.com/apache/tez/blob/master/tez-dag/src/main/java/org/apache/tez/dag/app/dag/impl/DAGImpl.java#L953

       

      It is possible that the state changed to "RUNNING" and signaling was done. However, if  getDAGStatus gets invoked later, it wouldn't receive any signal and ends up waiting until the timeout. For clients trying to report details on SUBMIT–>RUNNING, it ends up giving wrong picture.

       

      Attachments

        1. TEZ-4171.1.patch
          2 kB
          Rajesh Balamohan
        2. TEZ-4171.2.patch
          2 kB
          Rajesh Balamohan
        3. TEZ-4171.3.patch
          4 kB
          Rajesh Balamohan
        4. TEZ-4171.4.patch
          4 kB
          Rajesh Balamohan
        5. TEZ-4171.5.patch
          4 kB
          Rajesh Balamohan
        6. TEZ-4171.6.patch
          4 kB
          Rajesh Balamohan

        Activity

          People

            rajesh.balamohan Rajesh Balamohan
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: