Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11724

DistCp throws NPE when the target directory is root.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Distcp throws NPE when the target directory is root. It is due to CopyCommitter#cleanupTempFiles attempts to delete parent directory of root, which is null:

      $ hadoop distcp pom.xml hdfs://localhost/
      15/03/17 11:17:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      15/03/17 11:17:45 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[pom.xml], targetPath=hdfs://localhost/, targetPathExists=true, preserveRawXattrs=false}
      15/03/17 11:17:45 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
      15/03/17 11:17:45 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
      15/03/17 11:17:45 INFO Configuration.deprecation: io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
      15/03/17 11:17:45 INFO Configuration.deprecation: io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
      15/03/17 11:17:45 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
      15/03/17 11:17:45 INFO mapreduce.JobSubmitter: number of splits:1
      15/03/17 11:17:45 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local992233322_0001
      15/03/17 11:17:46 INFO mapreduce.Job: The url to track the job: http://localhost:8080/
      15/03/17 11:17:46 INFO tools.DistCp: DistCp job-id: job_local992233322_0001
      15/03/17 11:17:46 INFO mapreduce.Job: Running job: job_local992233322_0001
      15/03/17 11:17:46 INFO mapred.LocalJobRunner: OutputCommitter set in config null
      15/03/17 11:17:46 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
      15/03/17 11:17:46 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.tools.mapred.CopyCommitter
      15/03/17 11:17:46 INFO mapred.LocalJobRunner: Waiting for map tasks
      15/03/17 11:17:46 INFO mapred.LocalJobRunner: Starting task: attempt_local992233322_0001_m_000000_0
      15/03/17 11:17:46 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
      15/03/17 11:17:46 INFO util.ProcfsBasedProcessTree: ProcfsBasedProcessTree currently is supported only on Linux.
      15/03/17 11:17:46 INFO mapred.Task:  Using ResourceCalculatorProcessTree : null
      15/03/17 11:17:46 INFO mapred.MapTask: Processing split: file:/tmp/hadoop/mapred/staging/lei2046334351/.staging/_distcp-1889397390/fileList.seq:0+220
      15/03/17 11:17:46 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1
      15/03/17 11:17:46 INFO mapred.CopyMapper: Copying file:/Users/lei/work/cloudera/s3a_cp_target/pom.xml to hdfs://localhost/pom.xml
      15/03/17 11:17:46 INFO mapred.CopyMapper: Skipping copy of file:/Users/lei/work/cloudera/s3a_cp_target/pom.xml to hdfs://localhost/pom.xml
      15/03/17 11:17:46 INFO mapred.LocalJobRunner:
      15/03/17 11:17:46 INFO mapred.Task: Task:attempt_local992233322_0001_m_000000_0 is done. And is in the process of committing
      15/03/17 11:17:46 INFO mapred.LocalJobRunner:
      15/03/17 11:17:46 INFO mapred.Task: Task attempt_local992233322_0001_m_000000_0 is allowed to commit now
      15/03/17 11:17:46 INFO output.FileOutputCommitter: Saved output of task 'attempt_local992233322_0001_m_000000_0' to file:/tmp/hadoop/mapred/staging/lei2046334351/.staging/_distcp-1889397390/_logs/_temporary/0/task_local992233322_0001_m_000000
      15/03/17 11:17:46 INFO mapred.LocalJobRunner: Copying file:/Users/lei/work/cloudera/s3a_cp_target/pom.xml to hdfs://localhost/pom.xml
      15/03/17 11:17:46 INFO mapred.Task: Task 'attempt_local992233322_0001_m_000000_0' done.
      15/03/17 11:17:46 INFO mapred.LocalJobRunner: Finishing task: attempt_local992233322_0001_m_000000_0
      15/03/17 11:17:46 INFO mapred.LocalJobRunner: map task executor complete.
      15/03/17 11:17:46 INFO mapred.CopyCommitter: Remove parent: null for hdfs://localhost/
      15/03/17 11:17:46 WARN mapred.CopyCommitter: Unable to cleanup temp files
      java.lang.NullPointerException
      	at org.apache.hadoop.fs.Path.<init>(Path.java:104)
      	at org.apache.hadoop.fs.Path.<init>(Path.java:93)
      	at org.apache.hadoop.tools.mapred.CopyCommitter.deleteAttemptTempFiles(CopyCommitter.java:141)
      	at org.apache.hadoop.tools.mapred.CopyCommitter.cleanupTempFiles(CopyCommitter.java:130)
      	at org.apache.hadoop.tools.mapred.CopyCommitter.commitJob(CopyCommitter.java:83)
      	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:538)
      15/03/17 11:17:46 INFO mapred.CopyCommitter: Cleaning up temporary work folder: file:/tmp/hadoop/mapred/staging/lei2046334351/.staging/_distcp-1889397390
      15/03/17 11:17:47 INFO mapreduce.Job: Job job_local992233322_0001 running in uber mode : false
      15/03/17 11:17:47 INFO mapreduce.Job:  map 100% reduce 0%
      15/03/17 11:17:47 INFO mapreduce.Job: Job job_local992233322_0001 completed successfully
      15/03/17 11:17:47 INFO mapreduce.Job: Counters: 22
      	File System Counters
      		FILE: Number of bytes read=103917
      		FILE: Number of bytes written=363277
      		FILE: Number of read operations=0
      		FILE: Number of large read operations=0
      		FILE: Number of write operations=0
      		HDFS: Number of bytes read=0
      		HDFS: Number of bytes written=0
      		HDFS: Number of read operations=8
      		HDFS: Number of large read operations=0
      		HDFS: Number of write operations=0
      	Map-Reduce Framework
      		Map input records=1
      		Map output records=1
      		Input split bytes=151
      		Spilled Records=0
      		Failed Shuffles=0
      		Merged Map outputs=0
      		GC time elapsed (ms)=14
      		Total committed heap usage (bytes)=163577856
      	File Input Format Counters
      		Bytes Read=252
      	File Output Format Counters
      		Bytes Written=70
      	org.apache.hadoop.tools.mapred.CopyMapper$Counter
      		BYTESSKIPPED=23491
      		SKIP=1
      

      The distcp task can still success.

      1. HADOOP-11724.000.patch
        0.9 kB
        Lei (Eddy) Xu
      2. HADOOP-11724.001.patch
        1.0 kB
        Lei (Eddy) Xu
      3. HADOOP-11724.002.patch
        0.9 kB
        Lei (Eddy) Xu

        Issue Links

          Activity

          Hide
          eddyxu Lei (Eddy) Xu added a comment -

          Check whether parent directory is null in CopyCommitter#cleanupTempFiles.

          Show
          eddyxu Lei (Eddy) Xu added a comment - Check whether parent directory is null in CopyCommitter#cleanupTempFiles .
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12705156/HADOOP-11724.000.patch
          against trunk revision 32b4330.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-tools/hadoop-distcp.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5960//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5960//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12705156/HADOOP-11724.000.patch against trunk revision 32b4330. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-tools/hadoop-distcp. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5960//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5960//console This message is automatically generated.
          Hide
          eddyxu Lei (Eddy) Xu added a comment -

          The patch is trivial, so no test is included. Also:

          try {
                ...
                Path parent = targetWorkPath.getParent();
                if (parent != null) {
                  deleteAttemptTempFiles(parent, targetFS, jobId);
                }
              } catch (Throwable t) {
                LOG.warn("Unable to cleanup temp files", t);
              }
          

          The NPE is swallowed by the catch (Throwable), so that it is hard to observe in tests, other than log message.

          Show
          eddyxu Lei (Eddy) Xu added a comment - The patch is trivial, so no test is included. Also: try { ... Path parent = targetWorkPath.getParent(); if (parent != null ) { deleteAttemptTempFiles(parent, targetFS, jobId); } } catch (Throwable t) { LOG.warn( "Unable to cleanup temp files" , t); } The NPE is swallowed by the catch (Throwable) , so that it is hard to observe in tests, other than log message.
          Hide
          yzhangal Yongjun Zhang added a comment -

          Hi Lei (Eddy) Xu,

          Thanks for reporting the issue and the patch. I reviewed it, it seems that a more appropriate fix is to handle null parent correctly in {{ CopyCommitter#deleteTempFiles}}, rather than skipping the call to it when parent is null? Thanks.

          Show
          yzhangal Yongjun Zhang added a comment - Hi Lei (Eddy) Xu , Thanks for reporting the issue and the patch. I reviewed it, it seems that a more appropriate fix is to handle null parent correctly in {{ CopyCommitter#deleteTempFiles}}, rather than skipping the call to it when parent is null? Thanks.
          Hide
          eddyxu Lei (Eddy) Xu added a comment -

          Thanks a lot Yongjun Zhang. It is a great suggestion. I updated the patch for your comments. Would you mind take another look?

          Show
          eddyxu Lei (Eddy) Xu added a comment - Thanks a lot Yongjun Zhang . It is a great suggestion. I updated the patch for your comments. Would you mind take another look?
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12707138/HADOOP-11724.001.patch
          against trunk revision 53a28af.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-tools/hadoop-distcp.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5992//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5992//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707138/HADOOP-11724.001.patch against trunk revision 53a28af. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-tools/hadoop-distcp. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/5992//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5992//console This message is automatically generated.
          Hide
          eddyxu Lei (Eddy) Xu added a comment -

          No test is included, because the change is trivial.

          Show
          eddyxu Lei (Eddy) Xu added a comment - No test is included, because the change is trivial.
          Hide
          yzhangal Yongjun Zhang added a comment -

          HI Lei (Eddy) Xu,

          Thanks for the new rev. +1 after one nit: can we change:

          LOG.debug("Attempted to delete a null directory.");
          

          to:

          LOG.debug("Ignore attempt to delete temp files for distcp job " + jobId);
          

          OR we can remove this debug logging, which doesn't provide much info anyways since the first call to deleteAttemptTempFiles does LOG.info("Cleaning up " + file.getPath());

          Show
          yzhangal Yongjun Zhang added a comment - HI Lei (Eddy) Xu , Thanks for the new rev. +1 after one nit: can we change: LOG.debug( "Attempted to delete a null directory." ); to: LOG.debug( "Ignore attempt to delete temp files for distcp job " + jobId); OR we can remove this debug logging, which doesn't provide much info anyways since the first call to deleteAttemptTempFiles does LOG.info("Cleaning up " + file.getPath());
          Hide
          eddyxu Lei (Eddy) Xu added a comment -

          Hi, Yongjun Zhang

          Thanks for reviewing it. I removed the logs from the patch. The two alternative logs are similar, I think it would be better to defer writing logs in the future.

          Would it be good to you?

          Show
          eddyxu Lei (Eddy) Xu added a comment - Hi, Yongjun Zhang Thanks for reviewing it. I removed the logs from the patch. The two alternative logs are similar, I think it would be better to defer writing logs in the future. Would it be good to you?
          Hide
          yzhangal Yongjun Zhang added a comment -

          Thanks Eddy. +1. Will commit a bit later today.

          Show
          yzhangal Yongjun Zhang added a comment - Thanks Eddy. +1. Will commit a bit later today.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12707274/HADOOP-11724.002.patch
          against trunk revision 97e2aa2.

          -1 patch. Trunk compilation may be broken.

          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5999//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707274/HADOOP-11724.002.patch against trunk revision 97e2aa2. -1 patch . Trunk compilation may be broken. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/5999//console This message is automatically generated.
          Hide
          eddyxu Lei (Eddy) Xu added a comment -

          Re-upload the patch to trigger jenkin job

          Show
          eddyxu Lei (Eddy) Xu added a comment - Re-upload the patch to trigger jenkin job
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12707331/HADOOP-11724.002.patch
          against trunk revision fc1031a.

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-tools/hadoop-distcp.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/6000//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/6000//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12707331/HADOOP-11724.002.patch against trunk revision fc1031a. +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-tools/hadoop-distcp. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/6000//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/6000//console This message is automatically generated.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #7436 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7436/)
          HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac)

          • hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7436 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7436/ ) HADOOP-11724 . DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac) hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          yzhangal Yongjun Zhang added a comment -

          Thanks Eddy for the contribution, I committed to trunk and branch-2.

          Show
          yzhangal Yongjun Zhang added a comment - Thanks Eddy for the contribution, I committed to trunk and branch-2.
          Hide
          eddyxu Lei (Eddy) Xu added a comment -

          Thanks much for the reviews and committing this, Yongjun.

          Show
          eddyxu Lei (Eddy) Xu added a comment - Thanks much for the reviews and committing this, Yongjun.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #144 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/144/)
          HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #144 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/144/ ) HADOOP-11724 . DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #878 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/878/)
          HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac)

          • hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #878 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/878/ ) HADOOP-11724 . DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac) hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #144 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/144/)
          HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac)

          • hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #144 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/144/ ) HADOOP-11724 . DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac) hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2094 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2094/)
          HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac)

          • hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2094 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2094/ ) HADOOP-11724 . DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac) hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2076 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2076/)
          HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac)

          • hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          • hadoop-common-project/hadoop-common/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2076 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2076/ ) HADOOP-11724 . DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac) hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java hadoop-common-project/hadoop-common/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #135 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/135/)
          HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac)

          • hadoop-common-project/hadoop-common/CHANGES.txt
          • hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #135 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/135/ ) HADOOP-11724 . DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) (yzhang: rev 44809b80814d5520a73d5609d0f73a13eb2360ac) hadoop-common-project/hadoop-common/CHANGES.txt hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/CopyCommitter.java

            People

            • Assignee:
              eddyxu Lei (Eddy) Xu
              Reporter:
              eddyxu Lei (Eddy) Xu
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development