Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2261 YARN should have a way to run post-application cleanup
  3. YARN-3245

Find a way to reserve AMContainer resource to launch clean-up container in CapacityScheduler

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:
      None

      Description

      The clean-up container will be launched after the application is finished/killed/failed. Cleanup container may not get resources if we negotiate the resource for it separately because cluster may have gotten busy after the final AM exit. The propose is to reserve AMContainer resource, and use it to launch clean-up container. In that case, we do not need to re-negotiate the resource, and clean-up container can be launch in the same NM as AM.

        Attachments

          Activity

            People

            • Assignee:
              xgong Xuan Gong
              Reporter:
              xgong Xuan Gong
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: