Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2706

MR-279: Submit jobs beyond the max jobs per queue limit no longer gets logged

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None

      Description

      Submitting jobs over the queue limits used to print log messages such as these:
      hadoop-mapred-jobtracker-HOSTNAME.log. ... INFO
      org.apache.hadoop.mapred.CapacityTaskScheduler: default has 10 active tasks for user MYUSER, cannot initialize
      job_XXX with 10 tasks since it will exceed limit of 15 active tasks per user for this queue
      and
      hadoop-mapred-jobtracker-HOSTNAME.log ... INFO org.apache.hadoop.mapred.CapacityTaskScheduler: default already has 2 running jobs and 0 initializing jobs; cannot initialize job_XXX since it will exceeed limit of 2 initialized jobs for this queue

      These log messages are useful - especially for QA and testing.

      1. MAPREDUCE-2706.patch
        3 kB
        Jeffrey Naisbitt

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12486917/MAPREDUCE-2706.patch
        against trunk revision 1147981.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/477//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12486917/MAPREDUCE-2706.patch against trunk revision 1147981. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/477//console This message is automatically generated.
        Hide
        naisbitt Jeffrey Naisbitt added a comment -

        This patch is for the MR-279 branch, so the above test-patch results are not applicable

        Show
        naisbitt Jeffrey Naisbitt added a comment - This patch is for the MR-279 branch, so the above test-patch results are not applicable
        Hide
        revans2 Robert Joseph Evans added a comment -

        +1 The patch looks like a simple and straight forward change to make.

        Show
        revans2 Robert Joseph Evans added a comment - +1 The patch looks like a simple and straight forward change to make.
        Hide
        acmurthy Arun C Murthy added a comment -

        I just committed this. Thanks Jeffrey!

        Show
        acmurthy Arun C Murthy added a comment - I just committed this. Thanks Jeffrey!

          People

          • Assignee:
            naisbitt Jeffrey Naisbitt
            Reporter:
            naisbitt Jeffrey Naisbitt
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development