Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6242

Progress report log is incredibly excessive in application master

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We saw incredibly excessive logs in application master for a long running one with many task attempts. The log write rate is around 1MB/sec in some cases.

      Most of the log entries were from the progress report such as the following ones.

      2015-02-03 17:46:14,321 INFO [IPC Server handler 56 on 37661] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1422985365246_0001_m_000000_0 is : 0.15605757
      2015-02-03 17:46:17,581 INFO [IPC Server handler 2 on 37661] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1422985365246_0001_m_000000_0 is : 0.4108217
      2015-02-03 17:46:20,426 INFO [IPC Server handler 0 on 37661] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1422985365246_0001_m_000002_0 is : 0.06634143
      2015-02-03 17:46:20,807 INFO [IPC Server handler 4 on 37661] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1422985365246_0001_m_000000_0 is : 0.55556506
      2015-02-03 17:46:21,013 INFO [IPC Server handler 6 on 37661] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1422985365246_0001_m_000001_0 is : 0.21723115

      Looks like the report interval is controlled by a hard-coded variable PROGRESS_INTERVAL as 3 seconds in class org.apache.hadoop.mapred.Task. We should allow users to set the appropriate progress interval for their applications.

      1. MAPREDUCE-6242.branch-2.patch
        8 kB
        Varun Saxena
      2. MAPREDUCE-6242.003.patch
        8 kB
        Varun Saxena
      3. MAPREDUCE-6242.002.patch
        8 kB
        Varun Saxena
      4. MAPREDUCE-6242.001.patch
        8 kB
        Varun Saxena

        Issue Links

          Activity

          Hide
          kasha Karthik Kambatla added a comment -

          Was just made aware of this, by way of MAPREDUCE-6740. Thanks for adding this config.

          Thinking more about it, I wonder if the default should be a fraction of the task.timeout, say a tenth. By default, all longer tasks would then report progress every minute. Users could just change one config without thinking about the other. What do others think?

          Show
          kasha Karthik Kambatla added a comment - Was just made aware of this, by way of MAPREDUCE-6740 . Thanks for adding this config. Thinking more about it, I wonder if the default should be a fraction of the task.timeout, say a tenth. By default, all longer tasks would then report progress every minute. Users could just change one config without thinking about the other. What do others think?
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #142 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/142/)
          MAPREDUCE-6242. Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019)

          • hadoop-mapreduce-project/CHANGES.txt
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #142 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/142/ ) MAPREDUCE-6242 . Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019) hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #133 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/133/)
          MAPREDUCE-6242. Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019)

          • hadoop-mapreduce-project/CHANGES.txt
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #133 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/133/ ) MAPREDUCE-6242 . Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019) hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2074 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2074/)
          MAPREDUCE-6242. Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • hadoop-mapreduce-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2074 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2074/ ) MAPREDUCE-6242 . Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java hadoop-mapreduce-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2092 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2092/)
          MAPREDUCE-6242. Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          • hadoop-mapreduce-project/CHANGES.txt
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2092 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2092/ ) MAPREDUCE-6242 . Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #876 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/876/)
          MAPREDUCE-6242. Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • hadoop-mapreduce-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #876 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/876/ ) MAPREDUCE-6242 . Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java hadoop-mapreduce-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #142 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/142/)
          MAPREDUCE-6242. Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • hadoop-mapreduce-project/CHANGES.txt
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #142 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/142/ ) MAPREDUCE-6242 . Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7404 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7404/)
          MAPREDUCE-6242. Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019)

          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java
          • hadoop-mapreduce-project/CHANGES.txt
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7404 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7404/ ) MAPREDUCE-6242 . Progress report log is incredibly excessive in application (devaraj: rev 7e6f384dd742de21f29e96ee76df5316529c9019) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/Task.java hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestTaskProgressReporter.java
          Hide
          devaraj.k Devaraj K added a comment -

          Thanks Varun Saxena.

          Committed to trunk and branch-2.

          Show
          devaraj.k Devaraj K added a comment - Thanks Varun Saxena . Committed to trunk and branch-2.
          Hide
          devaraj.k Devaraj K added a comment -

          +1, looks good to me, will commit it shortly.

          Show
          devaraj.k Devaraj K added a comment - +1, looks good to me, will commit it shortly.
          Hide
          varun_saxena Varun Saxena added a comment -

          Devaraj K, updated the patch for branch-2. Kindly review

          Show
          varun_saxena Varun Saxena added a comment - Devaraj K , updated the patch for branch-2. Kindly review
          Hide
          varun_saxena Varun Saxena added a comment -

          Compilation failure as it is a branch-2 patch

          Show
          varun_saxena Varun Saxena added a comment - Compilation failure as it is a branch-2 patch
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12706025/MAPREDUCE-6242.branch-2.patch
          against trunk revision d81109e.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          -1 javac. The patch appears to cause the build to fail.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5319//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12706025/MAPREDUCE-6242.branch-2.patch against trunk revision d81109e. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. -1 javac . The patch appears to cause the build to fail. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5319//console This message is automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12706010/MAPREDUCE-6242.branch-2.patch
          against trunk revision 75ead27.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5318//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5318//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12706010/MAPREDUCE-6242.branch-2.patch against trunk revision 75ead27. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5318//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5318//console This message is automatically generated.
          Hide
          varun_saxena Varun Saxena added a comment -

          Thanks for the review Devaraj K. Will upload a branch-2 patch by EOD today

          Show
          varun_saxena Varun Saxena added a comment - Thanks for the review Devaraj K . Will upload a branch-2 patch by EOD today
          Hide
          devaraj.k Devaraj K added a comment -

          Thanks Varun Saxena for the updated patch.

          Latest patch looks good to me, it is applying fine for trunk and failing for branch-2. Could you provide a separate patch for branch-2? Thanks.

          Show
          devaraj.k Devaraj K added a comment - Thanks Varun Saxena for the updated patch. Latest patch looks good to me, it is applying fine for trunk and failing for branch-2. Could you provide a separate patch for branch-2? Thanks.
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12705830/MAPREDUCE-6242.003.patch
          against trunk revision e37ca22.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5316//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5316//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12705830/MAPREDUCE-6242.003.patch against trunk revision e37ca22. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5316//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5316//console This message is automatically generated.
          Hide
          devaraj.k Devaraj K added a comment -

          Thanks Varun Saxena for the patch.

          Patch looks good to me except these minor comments.

          1. There are some trailing whitespace in the newly added code. Can you try to avoid these whitespaces?

          <stdin>:9: trailing whitespace.
          ....
          warning: squelched 9 whitespace errors
          warning: 14 lines add whitespace error
          

          2. In testTaskProgress(), can you avoid interrupting the thread which throws InterruptedException and use the reporter.resetDoneFlag() for notifying the thread.

          t.interrupt();
          

          3. And also can you change the access specifier for these inner classes DummyTask, FakeUmbilical and DummyTaskReporter as private?

          Show
          devaraj.k Devaraj K added a comment - Thanks Varun Saxena for the patch. Patch looks good to me except these minor comments. 1. There are some trailing whitespace in the newly added code. Can you try to avoid these whitespaces? <stdin> :9: trailing whitespace. .... warning: squelched 9 whitespace errors warning: 14 lines add whitespace error 2. In testTaskProgress(), can you avoid interrupting the thread which throws InterruptedException and use the reporter.resetDoneFlag() for notifying the thread. t.interrupt(); 3. And also can you change the access specifier for these inner classes DummyTask, FakeUmbilical and DummyTaskReporter as private?
          Hide
          hadoopqa Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12701155/MAPREDUCE-6242.002.patch
          against trunk revision dce8b9c.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5228//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5228//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12701155/MAPREDUCE-6242.002.patch against trunk revision dce8b9c. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5228//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5228//console This message is automatically generated.
          Hide
          varun_saxena Varun Saxena added a comment -

          Vinod Kumar Vavilapalli, made the required change.

          Show
          varun_saxena Varun Saxena added a comment - Vinod Kumar Vavilapalli , made the required change.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Tx for working on this. Couple of minor comments

          • PROGRESS_REPORT_INTERVAL -> TASK_PROGRESS_REPORT_INTERVAL
          • mapreduce.task.progress.report.interval -> mapreduce.task.progress-report-interval.
          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Tx for working on this. Couple of minor comments PROGRESS_REPORT_INTERVAL -> TASK_PROGRESS_REPORT_INTERVAL mapreduce.task.progress.report.interval -> mapreduce.task.progress-report-interval.
          Hide
          varun_saxena Varun Saxena added a comment -

          Someone kindly review this.

          Show
          varun_saxena Varun Saxena added a comment - Someone kindly review this.
          Hide
          john.jian.fang Jian Fang added a comment -

          Thanks for your quick fix.

          Show
          john.jian.fang Jian Fang added a comment - Thanks for your quick fix.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12696817/MAPREDUCE-6242.001.patch
          against trunk revision d27439f.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          -1 eclipse:eclipse. The patch failed to build with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5163//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5163//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12696817/MAPREDUCE-6242.001.patch against trunk revision d27439f. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. -1 eclipse:eclipse . The patch failed to build with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5163//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5163//console This message is automatically generated.
          Hide
          varun_saxena Varun Saxena added a comment -

          Oh its urgent. Thanks for letting me know. Will fix this on priority and upload a patch today.

          Show
          varun_saxena Varun Saxena added a comment - Oh its urgent. Thanks for letting me know. Will fix this on priority and upload a patch today.
          Hide
          john.jian.fang Jian Fang added a comment -

          This seems to be easy to fix. Could you please let me know when the patch will be available? We have production issues due to this.

          Show
          john.jian.fang Jian Fang added a comment - This seems to be easy to fix. Could you please let me know when the patch will be available? We have production issues due to this.
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          This belongs to MR project, moving it.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - This belongs to MR project, moving it.

            People

            • Assignee:
              varun_saxena Varun Saxena
              Reporter:
              john.jian.fang Jian Fang
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development