Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6144

FairScheduler: preempted resources can become negative

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      preemptContainers() calls trackContainerForPreemption() to collect the list of containers and resources that were preempted for an application. Later the list is reduced when containerCompleted() calls untrackContainerForPreemption(). The bug is that the resource variable preemptedResources is subtracted, not just when the container was preempted but also when it has completed successfully. This causes that we return an incorrect value in getResourceUsage().

      Attachments

        1. YARN-6144.003.patch
          6 kB
          Miklos Szegedi
        2. YARN-6144.002.patch
          5 kB
          Miklos Szegedi
        3. YARN-6144.001.patch
          5 kB
          Miklos Szegedi
        4. YARN-6144.000.patch
          5 kB
          Miklos Szegedi
        5. Screen Shot 2017-02-02 at 12.49.14 PM.png
          51 kB
          Miklos Szegedi

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            miklos.szegedi@cloudera.com Miklos Szegedi
            miklos.szegedi@cloudera.com Miklos Szegedi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment