Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3535

YarnTaskScheduler can hold onto low priority containers until they expire

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.7.1, 0.8.4
    • None
    • None
    • None

    Description

      With container reuse enabled, YarnTaskScheduler will retain but not schedule any container allocations that are lower priority than the highest priority task requests. This can lead to poor performance as these lower priority containers clog up resources needed for high priority allocations.

      Attachments

        1. TEZ-3535.001.patch
          8 kB
          Jason Darrell Lowe

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-3491 Tez job can hang due to container priority inversion

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              jlowe Jason Darrell Lowe
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: