Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2324 Job should fail if a reduce task can't be scheduled anywhere
  3. MAPREDUCE-2723

MR-279: port MAPREDUCE-2324 to mrv2

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.23.0
    • None
    • mrv2
    • None

    Description

      MRV2 currently does not take reduce disk usage into account when trying to schedule a container. For feature parity with the original map reduce it should be extended to allow for disk space requests within containers along with RAM requests. We then also need to port MAPREDUCE-2324 to the scheduler to allow it to avoid starvation of containers that might never get the resources that they need.

      Attachments

        Activity

          People

            revans2 Robert Joseph Evans
            revans2 Robert Joseph Evans
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated: