Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2706

MR-279: Submit jobs beyond the max jobs per queue limit no longer gets logged

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None

      Description

      Submitting jobs over the queue limits used to print log messages such as these:
      hadoop-mapred-jobtracker-HOSTNAME.log. ... INFO
      org.apache.hadoop.mapred.CapacityTaskScheduler: default has 10 active tasks for user MYUSER, cannot initialize
      job_XXX with 10 tasks since it will exceed limit of 15 active tasks per user for this queue
      and
      hadoop-mapred-jobtracker-HOSTNAME.log ... INFO org.apache.hadoop.mapred.CapacityTaskScheduler: default already has 2 running jobs and 0 initializing jobs; cannot initialize job_XXX since it will exceeed limit of 2 initialized jobs for this queue

      These log messages are useful - especially for QA and testing.

      1. MAPREDUCE-2706.patch
        3 kB
        Jeffrey Naisbitt

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        9m 3s 1 Jeffrey Naisbitt 18/Jul/11 20:25
        Patch Available Patch Available Resolved Resolved
        23d 3h 6m 1 Arun C Murthy 10/Aug/11 23:32
        Resolved Resolved Closed Closed
        96d 1h 17m 1 Arun C Murthy 15/Nov/11 00:49
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Arun C Murthy added a comment -

        I just committed this. Thanks Jeffrey!

        Show
        Arun C Murthy added a comment - I just committed this. Thanks Jeffrey!
        Jeffrey Naisbitt made changes -
        Fix Version/s 0.23.0 [ 12315570 ]
        Hide
        Robert Joseph Evans added a comment -

        +1 The patch looks like a simple and straight forward change to make.

        Show
        Robert Joseph Evans added a comment - +1 The patch looks like a simple and straight forward change to make.
        Jeffrey Naisbitt made changes -
        Assignee Jeffrey Naisbitt [ naisbitt ]
        Hide
        Jeffrey Naisbitt added a comment -

        This patch is for the MR-279 branch, so the above test-patch results are not applicable

        Show
        Jeffrey Naisbitt added a comment - This patch is for the MR-279 branch, so the above test-patch results are not applicable
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12486917/MAPREDUCE-2706.patch
        against trunk revision 1147981.

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/477//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12486917/MAPREDUCE-2706.patch against trunk revision 1147981. +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/477//console This message is automatically generated.
        Jeffrey Naisbitt made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jeffrey Naisbitt made changes -
        Attachment MAPREDUCE-2706.patch [ 12486917 ]
        Jeffrey Naisbitt made changes -
        Attachment MAPREDUCE-2706.patch [ 12486916 ]
        Jeffrey Naisbitt made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-2706.patch [ 12486916 ]
        Jeffrey Naisbitt created issue -

          People

          • Assignee:
            Jeffrey Naisbitt
            Reporter:
            Jeffrey Naisbitt
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development