Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-722

More slots are getting reserved for HiRAM job tasks then required

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • capacity-sched
    • None
    • Cluster MR capacity=248/248 Map slot size=1500 mb and reduce slot size=2048 mb. Total number of nodes=124
      4 queues each having Capacity=25% User Limit=100%.

    • Reviewed

    Description

      Submitted a normal job with map=124=reduces
      After submitted High RAM with maps=31=reduces map.memory=1800 reduce.memory=2800
      Again 3 job maps=124=reduces
      total of 248 slots were reserved for both maps and reduces for High Job which much higher then required.
      Is observed in Hadoop 0.20.0

      Attachments

        1. MAPREDUCE-722.1.txt
          13 kB
          Vinod Kumar Vavilapalli
        2. MAPREDUCE-722.txt
          10 kB
          Vinod Kumar Vavilapalli

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vinodkv Vinod Kumar Vavilapalli
            karams Karam Singh
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment