Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5065 Umbrella JIRA of SLS fixes / improvements
  3. YARN-4779

Fix AM container allocation logic in SLS

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Currently, SLS uses unmanaged AM for simulated map-reduce applications. And first allocated container for each app is considered to be the master container.

      This could be problematic when preemption happens. CapacityScheduler preempt AM container at lowest priority, but the simulated AM container isn't recognized by scheduler – it is a normal container from scheduler's perspective.

      This JIRA tries to fix this logic: do the real AM allocation instead of using unmanaged AM.

      Attachments

        1. YARN-4779.5.patch
          27 kB
          Wangda Tan
        2. YARN-4779.4.patch
          25 kB
          Wangda Tan
        3. YARN-4779.3.patch
          24 kB
          Wangda Tan
        4. YARN-4779.2.patch
          23 kB
          Wangda Tan
        5. YARN-4779.1.patch
          23 kB
          Wangda Tan

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            leftnoteasy Wangda Tan
            leftnoteasy Wangda Tan
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment