Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4742 [Umbrella] Enhancements to Distributed Scheduling
  3. YARN-5338

Fix ContainerId fromString to correctly parse remotely allocated container Ids

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • 2.9.0, 3.0.0
    • yarn

    Description

      ContainerIds generated by the Local Scheduler on the NM monotonically decrements from 0 to distinguish them from incrementing containerIds generated by the RM.

      Since only the last 40 bits of the ContainerId are actually used, This patch ensures that -1 containerId maps to 2 ^40 -1 and the toString and fromString correctly parses these containerId.

      One implication of this is patch is that the containerId space is divided into 2. The top half will be used by remotely allocated containers and the bottom half by those allocated by the RM

      Attachments

        1. YARN-5338.001.patch
          3 kB
          Arun Suresh

        Activity

          People

            asuresh Arun Suresh
            asuresh Arun Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: