Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1867

Create new central dispatcher for Tez AM

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None
    • Reviewed

    Description

      The dispatcher should be able to federate events across multiple event specific dispatchers for AM control plane scalability. Add dispatcher specific thread names for easier debugging.

      Attachments

        1. TEZ-1867.1.patch
          18 kB
          Bikas Saha
        2. TEZ-1867.2.patch
          18 kB
          Bikas Saha
        3. TEZ-1867.3.patch
          20 kB
          Bikas Saha

        Issue Links

          is related to

          Sub-task - The sub-task of the issue TEZ-1789 Move speculator processing off the central dispatcher

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. TEZ-1714 Locking issue with StateChangeNotifier

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. TEZ-93 Use central AsyncDispatcher to relay events. Process events on different events based threads.

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-4501 Fix TestLocalMode timeouts - handle drained in case of InterruptedException

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-1195 Remove manual Thread creation from DAGAppMaster and all supporting classes in favor of shared and managed Thread pool (e.g., ExecutorService)

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. TEZ-1897 Create a concurrent version of AsyncDispatcher

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. TEZ-1914 VertexManager logic should not run on the central dispatcher

          • Major - Major loss of function.
          • Closed

          Activity

            People

              bikassaha Bikas Saha
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: