Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3733

Fix DominantRC#compare() does not work as expected if cluster resource is empty

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Steps to reproduce
      =================
      1. Install HA with 2 RM 2 NM (3072 MB * 2 total cluster)
      2. Configure map and reduce size to 512 MB after changing scheduler minimum size to 512 MB
      3. Configure capacity scheduler and AM limit to .5 (DominantResourceCalculator is configured)
      4. Submit 30 concurrent task
      5. Switch RM

      Actual
      =====
      For 12 Jobs AM gets allocated and all 12 starts running
      No other Yarn child is initiated , all 12 Jobs in Running state for ever

      Expected
      =======
      Only 6 should be running at a time since max AM allocated is .5 (3072 MB)

        Attachments

        1. 0001-YARN-3733.patch
          5 kB
          Rohith Sharma K S
        2. 0002-YARN-3733.patch
          10 kB
          Rohith Sharma K S
        3. 0002-YARN-3733.patch
          11 kB
          Rohith Sharma K S
        4. YARN-3733.patch
          6 kB
          Rohith Sharma K S

          Activity

            People

            • Assignee:
              rohithsharma Rohith Sharma K S
              Reporter:
              bibinchundatt Bibin A Chundatt
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: