Hadoop Common
  1. Hadoop Common
  2. HADOOP-4873

display minMaps/Reduces on advanced scheduler page

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.19.0
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Changed fair scheduler UI to display minMaps and minReduces variables.

      Description

      the deficit and minMap are the most important variables for purposes of scheduling. showing the minMaps would help in debugging any scheduling issues

      1. 4873-1.patch
        2 kB
        Joydeep Sen Sarma

        Activity

        Joydeep Sen Sarma created issue -
        Joydeep Sen Sarma made changes -
        Field Original Value New Value
        Assignee Joydeep Sen Sarma [ jsensarma ]
        Joydeep Sen Sarma made changes -
        Attachment 4873-1.patch [ 12396274 ]
        Joydeep Sen Sarma made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.19.1 [ 12313473 ]
        Fix Version/s 0.20.0 [ 12313438 ]
        Affects Version/s 0.19.0 [ 12313211 ]
        Hide
        Zheng Shao added a comment -

        +1

        Show
        Zheng Shao added a comment - +1
        Hide
        Matei Zaharia added a comment -

        +1

        Show
        Matei Zaharia added a comment - +1
        Hide
        Matei Zaharia added a comment -

        I ran this through test-patch on my laptop and got the following output:

        [exec] -1 overall.
        [exec]
        [exec] +1 @author. The patch does not contain any @author tags.
        [exec]
        [exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
        [exec] Please justify why no tests are needed for this patch.
        [exec]
        [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
        [exec]
        [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
        [exec]
        [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
        [exec]
        [exec] -1 Eclipse classpath. The patch causes the Eclipse classpath to differ from the contents of the lib directories.
        [exec]
        [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

        The Eclipse classpath warning happens for unmodified trunk too, and this UI change is too small to need tests, so I will commit the patch.

        Show
        Matei Zaharia added a comment - I ran this through test-patch on my laptop and got the following output: [exec] -1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] -1 tests included. The patch doesn't appear to include any new or modified tests. [exec] Please justify why no tests are needed for this patch. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] -1 Eclipse classpath. The patch causes the Eclipse classpath to differ from the contents of the lib directories. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. The Eclipse classpath warning happens for unmodified trunk too, and this UI change is too small to need tests, so I will commit the patch.
        Hide
        Matei Zaharia added a comment -

        I've committed this. Thanks Joydeep!

        I can't mark the issue resolved though due to some issue with my JIRA permissions however.

        Show
        Matei Zaharia added a comment - I've committed this. Thanks Joydeep! I can't mark the issue resolved though due to some issue with my JIRA permissions however.
        Hide
        Tom White added a comment -

        Matei,

        I just changed your Jira permissions so you should be able to resolve this now. Also, you should update CHANGES.txt with an entry about the change. Thanks.

        Show
        Tom White added a comment - Matei, I just changed your Jira permissions so you should be able to resolve this now. Also, you should update CHANGES.txt with an entry about the change. Thanks.
        Hide
        Hudson added a comment -
        Show
        Hudson added a comment - Integrated in Hadoop-trunk #756 (See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/756/ )
        Matei Zaharia made changes -
        Hadoop Flags [Reviewed]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Release Note Display minMaps/minReduces on fair scheduler web UI.
        Matei Zaharia made changes -
        Fix Version/s 0.19.1 [ 12313473 ]
        Robert Chansler made changes -
        Release Note Display minMaps/minReduces on fair scheduler web UI. Changed fair scheduler UI to display minMaps and minReduces variables.
        Nigel Daley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Owen O'Malley made changes -
        Component/s contrib/fair-share [ 12312456 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        1d 8h 23m 1 Joydeep Sen Sarma 17/Dec/08 03:32
        Patch Available Patch Available Resolved Resolved
        62d 2h 13m 1 Matei Zaharia 17/Feb/09 05:46
        Resolved Resolved Closed Closed
        65d 13h 31m 1 Nigel Daley 23/Apr/09 20:17

          People

          • Assignee:
            Joydeep Sen Sarma
            Reporter:
            Joydeep Sen Sarma
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development