Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1273

Refactor DAGAppMaster to state machine based

Agile BoardAttach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Almost all our entities (Vertex, Task etc) are state machine based and written using a formal state machine. But DAGAppMaster is not written on a formal state machine even though it has a state machine based behavior. This jira is for refactoring it into state machine based

      Attachments

        1. dag_app_master.pdf
          27 kB
          Jeff Zhang
        2. dag_app_master2.pdf
          29 kB
          Jeff Zhang
        3. DAGAppMaster_3.pdf
          28 kB
          Jeff Zhang
        4. DAGAppMaster_4.pdf
          28 kB
          Jeff Zhang
        5. DAGAppMaster_5.pdf
          29 kB
          Jeff Zhang
        6. Tez-1273.patch
          67 kB
          Jeff Zhang
        7. TEZ-1273-10.patch
          110 kB
          Jeff Zhang
        8. Tez-1273-2.patch
          68 kB
          Jeff Zhang
        9. TEZ-1273-3.patch
          79 kB
          Jeff Zhang
        10. TEZ-1273-4.patch
          92 kB
          Jeff Zhang
        11. TEZ-1273-5.patch
          95 kB
          Jeff Zhang
        12. TEZ-1273-6.patch
          113 kB
          Jeff Zhang
        13. TEZ-1273-7.patch
          119 kB
          Jeff Zhang
        14. TEZ-1273-8.patch
          110 kB
          Jeff Zhang
        15. TEZ-1273-9.patch
          110 kB
          Jeff Zhang

        Issue Links

        relates to

        Sub-task - The sub-task of the issue TEZ-1954 Multiple instances of Inconsistent synchronization in org.apache.tez.dag.app.DAGAppMaster.

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. TEZ-1843 AM should go to KILLED state when it is killed in RUNNING state

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. TEZ-1885 Should check whether AM is shutting down first in submitDAGToAppMaster

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. TEZ-2375 Don't return dag status to client when dag is still in recovering

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. TEZ-2428 Investigate ignored event: DAGAppMaster: ignore event when DAGAppMaster is in the state of STOPPED, eventType=NEW_DAG_SUBMITTED

        • Major - Major loss of function.
        • Open

        Bug - A problem which impairs or prevents the functions of the product. TEZ-2359 Deadlock in DAGAppMaster

        • Blocker - Blocks development and/or testing work, production could not run
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. TEZ-2307 Possible wrong error message when submitting new dag

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zjffdu Jeff Zhang
            zjffdu Jeff Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment