Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3383

Duplicate job.getOutputValueGroupingComparator() in ReduceTask

        Details

        • Type: Bug
        • Status: Resolved
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: 0.23.1
        • Fix Version/s: 2.8.0, 3.0.0-alpha1
        • Component/s: None
        • Labels:
          None
        • Target Version/s:
        • Hadoop Flags:
          Reviewed

          Description

          This is probably just a small error by mistake.

          1. Text File
            MAPREDUCE-3383.patch
            1 kB
            Mohammad Shahid Khan
          2. Text File
            MAPREDUCE-3383.patch
            1.0 kB
            Binglin Chang
          3. Text File
            MAPREDUCE-3383-1.patch
            1.0 kB
            Devaraj K

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            decster Binglin Chang added a comment -

            Very small change, don't need any test I think.

            Show
            decster Binglin Chang added a comment - Very small change, don't need any test I think.
            Hide
            Permalink
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12503025/MAPREDUCE-3383.patch
            against trunk revision d6e05c5.

            +1 @author. The patch does not contain any @author tags.

            -1 tests included. The patch doesn't appear to include any new or modified tests.
            Please justify why no new tests are needed for this patch.
            Also please list what manual steps were performed to verify this patch.

            +1 javac. The applied patch does not increase the total number of javac compiler warnings.

            +1 javadoc. There were no new javadoc warning messages.

            +1 eclipse:eclipse. The patch built with eclipse:eclipse.

            +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

            +1 release audit. The applied patch does not increase the total number of release audit warnings.

            +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

            Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5250//testReport/
            Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5250//console

            This message is automatically generated.

            Show
            hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12503025/MAPREDUCE-3383.patch against trunk revision d6e05c5. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5250//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5250//console This message is automatically generated.
            Hide
            Permalink
            mohdshahidkhan Mohammad Shahid Khan added a comment -

            +1 Changes looks good no need of additional test case as only the code quality is improbed

            Show
            mohdshahidkhan Mohammad Shahid Khan added a comment - +1 Changes looks good no need of additional test case as only the code quality is improbed
            Hide
            Permalink
            devaraj.k Devaraj K added a comment -

            Thanks Binglin Chang for the patch and Mohammad Shahid Khan for review.

            Changes looks good to me except there is a whitespace warning with the patch, can you have look into this?

            <stdin>:10: trailing whitespace.
          comparator, keyClass, valueClass,
warning: 1 line adds whitespace errors.
            Show
            devaraj.k Devaraj K added a comment - Thanks Binglin Chang for the patch and Mohammad Shahid Khan for review. Changes looks good to me except there is a whitespace warning with the patch, can you have look into this? <stdin> :10: trailing whitespace. comparator, keyClass, valueClass, warning: 1 line adds whitespace errors.
            Hide
            Permalink
            mohdshahidkhan Mohammad Shahid Khan added a comment -

            re submitting the patch after correcting the format

            Show
            mohdshahidkhan Mohammad Shahid Khan added a comment - re submitting the patch after correcting the format
            Hide
            Permalink
            devaraj.k Devaraj K added a comment -

            whitespace error appears with the latest patch as well.

            Show
            devaraj.k Devaraj K added a comment - whitespace error appears with the latest patch as well.
            Hide
            Permalink
            devaraj.k Devaraj K added a comment -

            Updating the patch with white space fix.

            Show
            devaraj.k Devaraj K added a comment - Updating the patch with white space fix.
            Hide
            Permalink
            hadoopqa Hadoop QA added a comment -



            -1 overall



            Vote Subsystem Runtime Comment
            0 pre-patch 14m 51s Pre-patch trunk compilation is healthy.
            +1 @author 0m 0s The patch does not contain any @author tags.
            -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
            +1 javac 7m 44s There were no new javac warning messages.
            +1 javadoc 9m 45s There were no new javadoc warning messages.
            +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings.
            +1 checkstyle 0m 50s There were no new checkstyle issues.
            +1 whitespace 0m 0s The patch has no lines that end in whitespace.
            +1 install 1m 39s mvn install still works.
            +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse.
            +1 findbugs 1m 17s The patch does not introduce any new Findbugs (version 2.0.3) warnings.
            +1 mapreduce tests 1m 37s Tests passed in hadoop-mapreduce-client-core.
                38m 43s  



            Subsystem Report/Notes
            Patch URL http://issues.apache.org/jira/secure/attachment/12731480/MAPREDUCE-3383-1.patch
            Optional Tests javadoc javac unit findbugs checkstyle
            git revision trunk / f4ebbc6
            hadoop-mapreduce-client-core test log https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5675/artifact/patchprocess/testrun_hadoop-mapreduce-client-core.txt
            Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5675/testReport/
            Java 1.7.0_55
            uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
            Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5675/console

            This message was automatically generated.

            Show
            hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 14m 51s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 44s There were no new javac warning messages. +1 javadoc 9m 45s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 50s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 39s mvn install still works. +1 eclipse:eclipse 0m 33s The patch built with eclipse:eclipse. +1 findbugs 1m 17s The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 mapreduce tests 1m 37s Tests passed in hadoop-mapreduce-client-core.     38m 43s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12731480/MAPREDUCE-3383-1.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f4ebbc6 hadoop-mapreduce-client-core test log https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5675/artifact/patchprocess/testrun_hadoop-mapreduce-client-core.txt Test Results https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5675/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5675/console This message was automatically generated.
            Hide
            Permalink
            jlowe Jason Lowe added a comment -

            +1 lgtm. Committing this.

            Show
            jlowe Jason Lowe added a comment - +1 lgtm. Committing this.
            Hide
            Permalink
            jlowe Jason Lowe added a comment -

            Thanks to Binglin for the contribution, Mohammad for review, and to Devaraj for the whitespace cleanup and review! I committed this to trunk and branch-2.

            Show
            jlowe Jason Lowe added a comment - Thanks to Binglin for the contribution, Mohammad for review, and to Devaraj for the whitespace cleanup and review! I committed this to trunk and branch-2.
            Hide
            Permalink
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-trunk-Commit #7779 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7779/)
            MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90)

            • hadoop-mapreduce-project/CHANGES.txt
            • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            Show
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7779 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7779/ ) MAPREDUCE-3383 . Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90) hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            Hide
            Permalink
            hudson Hudson added a comment -

            SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #191 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/191/)
            MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90)

            • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            • hadoop-mapreduce-project/CHANGES.txt
            Show
            hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #191 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/191/ ) MAPREDUCE-3383 . Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java hadoop-mapreduce-project/CHANGES.txt
            Hide
            Permalink
            hudson Hudson added a comment -

            SUCCESS: Integrated in Hadoop-Yarn-trunk #922 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/922/)
            MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90)

            • hadoop-mapreduce-project/CHANGES.txt
            • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            Show
            hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #922 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/922/ ) MAPREDUCE-3383 . Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90) hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            Hide
            Permalink
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Hdfs-trunk #2120 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2120/)
            MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90)

            • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            • hadoop-mapreduce-project/CHANGES.txt
            Show
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2120 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2120/ ) MAPREDUCE-3383 . Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java hadoop-mapreduce-project/CHANGES.txt
            Hide
            Permalink
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #180 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/180/)
            MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90)

            • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            • hadoop-mapreduce-project/CHANGES.txt
            Show
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #180 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/180/ ) MAPREDUCE-3383 . Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java hadoop-mapreduce-project/CHANGES.txt
            Hide
            Permalink
            hudson Hudson added a comment -

            SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/190/)
            MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90)

            • hadoop-mapreduce-project/CHANGES.txt
            • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            Show
            hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/190/ ) MAPREDUCE-3383 . Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90) hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            Hide
            Permalink
            hudson Hudson added a comment -

            SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2138 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2138/)
            MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90)

            • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java
            • hadoop-mapreduce-project/CHANGES.txt
            Show
            hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2138 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2138/ ) MAPREDUCE-3383 . Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang (jlowe: rev c39012f4a0444f9e4b7d67957d5192127d143d90) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/ReduceTask.java hadoop-mapreduce-project/CHANGES.txt

              People

              • Assignee:
                decster Binglin Chang
                Reporter:
                decster Binglin Chang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development