Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2706

MR-279: Submit jobs beyond the max jobs per queue limit no longer gets logged

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None

      Description

      Submitting jobs over the queue limits used to print log messages such as these:
      hadoop-mapred-jobtracker-HOSTNAME.log. ... INFO
      org.apache.hadoop.mapred.CapacityTaskScheduler: default has 10 active tasks for user MYUSER, cannot initialize
      job_XXX with 10 tasks since it will exceed limit of 15 active tasks per user for this queue
      and
      hadoop-mapred-jobtracker-HOSTNAME.log ... INFO org.apache.hadoop.mapred.CapacityTaskScheduler: default already has 2 running jobs and 0 initializing jobs; cannot initialize job_XXX since it will exceeed limit of 2 initialized jobs for this queue

      These log messages are useful - especially for QA and testing.

      1. MAPREDUCE-2706.patch
        3 kB
        Jeffrey Naisbitt

        Activity

        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12486917/MAPREDUCE-2706.patch
        against trunk revision 1147981.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/477//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12486917/MAPREDUCE-2706.patch against trunk revision 1147981. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/477//console This message is automatically generated.
        Hide
        Jeffrey Naisbitt added a comment -

        This patch is for the MR-279 branch, so the above test-patch results are not applicable

        Show
        Jeffrey Naisbitt added a comment - This patch is for the MR-279 branch, so the above test-patch results are not applicable
        Hide
        Robert Joseph Evans added a comment -

        +1 The patch looks like a simple and straight forward change to make.

        Show
        Robert Joseph Evans added a comment - +1 The patch looks like a simple and straight forward change to make.
        Hide
        Arun C Murthy added a comment -

        I just committed this. Thanks Jeffrey!

        Show
        Arun C Murthy added a comment - I just committed this. Thanks Jeffrey!

          People

          • Assignee:
            Jeffrey Naisbitt
            Reporter:
            Jeffrey Naisbitt
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development