Hadoop Common
  1. Hadoop Common
  2. HADOOP-4873

display minMaps/Reduces on advanced scheduler page

        Details

        • Type: Bug Bug
        • Status: Closed
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: 0.19.0
        • Fix Version/s: 0.20.0
        • Component/s: None
        • Labels:
          None
        • Hadoop Flags:
          Reviewed
        • Release Note:
          Changed fair scheduler UI to display minMaps and minReduces variables.

          Description

          the deficit and minMap are the most important variables for purposes of scheduling. showing the minMaps would help in debugging any scheduling issues

          1. Text File
            4873-1.patch
            2 kB
            Joydeep Sen Sarma

            Activity

            Ascending order - Click to sort in descending order
            Joydeep Sen Sarma created issue -
            Joydeep Sen Sarma made changes -
            Field Original Value New Value
            Assignee Joydeep Sen Sarma [ jsensarma ]
            Joydeep Sen Sarma made changes -
            Attachment 4873-1.patch [ 12396274 ]
            Joydeep Sen Sarma made changes -
            Status Open [ 1 ] Patch Available [ 10002 ]
            Fix Version/s 0.19.1 [ 12313473 ]
            Fix Version/s 0.20.0 [ 12313438 ]
            Affects Version/s 0.19.0 [ 12313211 ]
            Hide
            Permalink
            Zheng Shao added a comment -

            +1

            Show
            Zheng Shao added a comment - +1
            Hide
            Permalink
            Matei Zaharia added a comment -

            +1

            Show
            Matei Zaharia added a comment - +1
            Hide
            Permalink
            Matei Zaharia added a comment -

            I ran this through test-patch on my laptop and got the following output:

            [exec] -1 overall.
            [exec]
            [exec] +1 @author. The patch does not contain any @author tags.
            [exec]
            [exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
            [exec] Please justify why no tests are needed for this patch.
            [exec]
            [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
            [exec]
            [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
            [exec]
            [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
            [exec]
            [exec] -1 Eclipse classpath. The patch causes the Eclipse classpath to differ from the contents of the lib directories.
            [exec]
            [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

            The Eclipse classpath warning happens for unmodified trunk too, and this UI change is too small to need tests, so I will commit the patch.

            Show
            Matei Zaharia added a comment - I ran this through test-patch on my laptop and got the following output: [exec] -1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] -1 tests included. The patch doesn't appear to include any new or modified tests. [exec] Please justify why no tests are needed for this patch. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings. [exec] [exec] -1 Eclipse classpath. The patch causes the Eclipse classpath to differ from the contents of the lib directories. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. The Eclipse classpath warning happens for unmodified trunk too, and this UI change is too small to need tests, so I will commit the patch.
            Hide
            Permalink
            Matei Zaharia added a comment -

            I've committed this. Thanks Joydeep!

            I can't mark the issue resolved though due to some issue with my JIRA permissions however.

            Show
            Matei Zaharia added a comment - I've committed this. Thanks Joydeep! I can't mark the issue resolved though due to some issue with my JIRA permissions however.
            Hide
            Permalink
            Tom White added a comment -

            Matei,

            I just changed your Jira permissions so you should be able to resolve this now. Also, you should update CHANGES.txt with an entry about the change. Thanks.

            Show
            Tom White added a comment - Matei, I just changed your Jira permissions so you should be able to resolve this now. Also, you should update CHANGES.txt with an entry about the change. Thanks.
            Hide
            Permalink
            Hudson added a comment -

            Integrated in Hadoop-trunk #756 (See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/756/)

            Show
            Hudson added a comment - Integrated in Hadoop-trunk #756 (See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/756/ )
            Matei Zaharia made changes -
            Hadoop Flags [Reviewed]
            Status Patch Available [ 10002 ] Resolved [ 5 ]
            Resolution Fixed [ 1 ]
            Release Note Display minMaps/minReduces on fair scheduler web UI.
            Matei Zaharia made changes -
            Fix Version/s 0.19.1 [ 12313473 ]
            Robert Chansler made changes -
            Release Note Display minMaps/minReduces on fair scheduler web UI. Changed fair scheduler UI to display minMaps and minReduces variables.
            Nigel Daley made changes -
            Status Resolved [ 5 ] Closed [ 6 ]
            Owen O'Malley made changes -
            Component/s contrib/fair-share [ 12312456 ]

              People

              • Assignee:
                Joydeep Sen Sarma
                Reporter:
                Joydeep Sen Sarma
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development