Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3733

Fix DominantRC#compare() does not work as expected if cluster resource is empty

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Steps to reproduce
      =================
      1. Install HA with 2 RM 2 NM (3072 MB * 2 total cluster)
      2. Configure map and reduce size to 512 MB after changing scheduler minimum size to 512 MB
      3. Configure capacity scheduler and AM limit to .5 (DominantResourceCalculator is configured)
      4. Submit 30 concurrent task
      5. Switch RM

      Actual
      =====
      For 12 Jobs AM gets allocated and all 12 starts running
      No other Yarn child is initiated , all 12 Jobs in Running state for ever

      Expected
      =======
      Only 6 should be running at a time since max AM allocated is .5 (3072 MB)

      Attachments

        1. YARN-3733.patch
          6 kB
          Rohith Sharma K S
        2. 0002-YARN-3733.patch
          11 kB
          Rohith Sharma K S
        3. 0002-YARN-3733.patch
          10 kB
          Rohith Sharma K S
        4. 0001-YARN-3733.patch
          5 kB
          Rohith Sharma K S

        Activity

          People

            rohithsharma Rohith Sharma K S
            bibinchundatt Bibin Chundatt
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: