Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1897

Create a concurrent version of AsyncDispatcher

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None
    • Reviewed

    Description

      Currently, it processes events on a single thread. For events that can be executed in parallel, e.g. vertex manager events, allowing higher concurrency may be beneficial.

      Attachments

        1. TEZ-1897.1.patch
          14 kB
          Bikas Saha
        2. TEZ-1897.2.patch
          14 kB
          Bikas Saha
        3. TEZ-1897.3.patch
          13 kB
          Bikas Saha
        4. TEZ-1897.4.patch
          49 kB
          Bikas Saha
        5. TEZ-1897.5.patch
          57 kB
          Bikas Saha
        6. TEZ-1897.6.patch
          66 kB
          Bikas Saha
        7. TEZ-1897.7.patch
          67 kB
          Bikas Saha
        8. TEZ-1897.8.patch
          67 kB
          Bikas Saha

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-1714 Locking issue with StateChangeNotifier

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-1867 Create new central dispatcher for Tez AM

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. TEZ-753 [Umbrella] Scalability improvements

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-2404 Handle DataMovementEvent before its TaskAttemptCompletedEvent

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-1195 Remove manual Thread creation from DAGAppMaster and all supporting classes in favor of shared and managed Thread pool (e.g., ExecutorService)

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-4067 Tez Speculation decision is calculated on each update by the dispatcher

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. TEZ-1914 VertexManager logic should not run on the central dispatcher

          • Major - Major loss of function.
          • Closed

          Activity

            People

              bikassaha Bikas Saha
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: