Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2808

Race condition between preemption and container assignment

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.1, 0.5.5, 0.6.3, 0.8.1-alpha
    • None
    • None
    • Reviewed

    Description

      New container allocated. Put in delayed container manager queue. Triggers assignment run on delayed container manager thread.
      On AMRMClient thread callback, preemption is called. This is to ensure preemption logic is guaranteed to be invoked at regular intervals even though nothing else may be happening because there are no containers allocated/to-match. Preemption logic checks if containers are available to assign by looking at delayed container manager queue. If by this time, the assignment thread has polled the queue to remove the container for assignment checking, then the preemption code will see no containers available to assign. So it proceeds to preempt containers.

      Attachments

        1. TEZ-2808.1.patch
          2 kB
          Bikas Saha

        Activity

          People

            bikassaha Bikas Saha
            bikassaha Bikas Saha
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: