Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3946

If a resource requirement is higher than available on any node, job should fail early

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 0.23.2, 2.0.0-alpha
    • Fix Version/s: None
    • Component/s: resourcemanager
    • Labels:
      None

      Description

      If you configure the NMs to have 1GB of RAM each, and then try to submit a job which has an AM resource requirement of 1.5GB, the job will neither run nor fail. Instead, it will slowly sop of all of the resources in the cluster as "reservations" despite the fact that it will never be able to schedule something. Instead, it should fail early indicating that the required memory allocation is infeasible.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: