Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-722

More slots are getting reserved for HiRAM job tasks then required

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: capacity-sched
    • Labels:
      None
    • Environment:

      Cluster MR capacity=248/248 Map slot size=1500 mb and reduce slot size=2048 mb. Total number of nodes=124
      4 queues each having Capacity=25% User Limit=100%.

    • Hadoop Flags:
      Reviewed

      Description

      Submitted a normal job with map=124=reduces
      After submitted High RAM with maps=31=reduces map.memory=1800 reduce.memory=2800
      Again 3 job maps=124=reduces
      total of 248 slots were reserved for both maps and reduces for High Job which much higher then required.
      Is observed in Hadoop 0.20.0

      1. MAPREDUCE-722.1.txt
        13 kB
        Vinod Kumar Vavilapalli
      2. MAPREDUCE-722.txt
        10 kB
        Vinod Kumar Vavilapalli

        Activity

        Karam Singh created issue -
        Vinod Kumar Vavilapalli made changes -
        Field Original Value New Value
        Assignee Vinod K V [ vinodkv ]
        Vinod Kumar Vavilapalli made changes -
        Attachment MAPREDUCE-722.txt [ 12412734 ]
        Vinod Kumar Vavilapalli made changes -
        Attachment MAPREDUCE-722.1.txt [ 12412744 ]
        Hemanth Yamijala made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.21.0 [ 12314045 ]
        Resolution Fixed [ 1 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Vinod Kumar Vavilapalli
            Reporter:
            Karam Singh
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development