Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4558

Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.19.0
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      Cluster Capacity Maps=Reduces =210 each
      Two Queues:
      Q1: default, GC (%) =40, GC=84 (Maps and Reduces each). Reclaim time = 3 mins.
      Q2: test_q1, GC (%) =60, GC=126 (Maps and Reduces each) Reclaim time = 2 mins

    • Hadoop Flags:
      Reviewed

      Description

      Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other.
      First job submitted with tasks equal to cluster's M/R Capacity
      Second is submitted to different queue when all tasks of First Job are running, scheduler fails to reclaim capacity for second job.

        Attachments

        1. 4558.1.patch
          1 kB
          Vivek Ratan
        2. HADOOP-4558-v1.4.patch
          9 kB
          Amar Kamat
        3. HADOOP-4558-v1.5.patch
          8 kB
          Amar Kamat
        4. HADOOP-4558-v1.7.patch
          8 kB
          Amar Kamat

          Issue Links

            Activity

              People

              • Assignee:
                amar_kamat Amar Kamat
                Reporter:
                karams Karam Singh
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: