Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6144

FairScheduler: preempted resources can become negative

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      preemptContainers() calls trackContainerForPreemption() to collect the list of containers and resources that were preempted for an application. Later the list is reduced when containerCompleted() calls untrackContainerForPreemption(). The bug is that the resource variable preemptedResources is subtracted, not just when the container was preempted but also when it has completed successfully. This causes that we return an incorrect value in getResourceUsage().

        Attachments

        1. Screen Shot 2017-02-02 at 12.49.14 PM.png
          51 kB
          Miklos Szegedi
        2. YARN-6144.000.patch
          5 kB
          Miklos Szegedi
        3. YARN-6144.001.patch
          5 kB
          Miklos Szegedi
        4. YARN-6144.002.patch
          5 kB
          Miklos Szegedi
        5. YARN-6144.003.patch
          6 kB
          Miklos Szegedi

        Issue Links

          Activity

            People

            • Assignee:
              miklos.szegedi@cloudera.com Miklos Szegedi
              Reporter:
              miklos.szegedi@cloudera.com Miklos Szegedi

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment