Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1273

Refactor DAGAppMaster to state machine based

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Almost all our entities (Vertex, Task etc) are state machine based and written using a formal state machine. But DAGAppMaster is not written on a formal state machine even though it has a state machine based behavior. This jira is for refactoring it into state machine based

      Attachments

        1. TEZ-1273-9.patch
          110 kB
          Jeff Zhang
        2. TEZ-1273-8.patch
          110 kB
          Jeff Zhang
        3. TEZ-1273-7.patch
          119 kB
          Jeff Zhang
        4. TEZ-1273-6.patch
          113 kB
          Jeff Zhang
        5. TEZ-1273-5.patch
          95 kB
          Jeff Zhang
        6. TEZ-1273-4.patch
          92 kB
          Jeff Zhang
        7. TEZ-1273-3.patch
          79 kB
          Jeff Zhang
        8. Tez-1273-2.patch
          68 kB
          Jeff Zhang
        9. TEZ-1273-10.patch
          110 kB
          Jeff Zhang
        10. Tez-1273.patch
          67 kB
          Jeff Zhang
        11. DAGAppMaster_5.pdf
          29 kB
          Jeff Zhang
        12. DAGAppMaster_4.pdf
          28 kB
          Jeff Zhang
        13. DAGAppMaster_3.pdf
          28 kB
          Jeff Zhang
        14. dag_app_master2.pdf
          29 kB
          Jeff Zhang
        15. dag_app_master.pdf
          27 kB
          Jeff Zhang

        Issue Links

          relates to

          Sub-task - The sub-task of the issue TEZ-1954 Multiple instances of Inconsistent synchronization in org.apache.tez.dag.app.DAGAppMaster.

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. TEZ-1843 AM should go to KILLED state when it is killed in RUNNING state

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. TEZ-1885 Should check whether AM is shutting down first in submitDAGToAppMaster

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. TEZ-2375 Don't return dag status to client when dag is still in recovering

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. TEZ-2428 Investigate ignored event: DAGAppMaster: ignore event when DAGAppMaster is in the state of STOPPED, eventType=NEW_DAG_SUBMITTED

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. TEZ-2359 Deadlock in DAGAppMaster

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. TEZ-2307 Possible wrong error message when submitting new dag

          • Major - Major loss of function.
          • Closed

          Activity

            People

              zjffdu Jeff Zhang
              zjffdu Jeff Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: