Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.3
    • Component/s: distcp, documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Timestamp preservation was added back into DistCp as part of HADOOP-11009 but the documentation wasn't updated. The documentation should be updated.

        Issue Links

          Activity

          Hide
          jojochuang Wei-Chiu Chuang added a comment -

          Hi Gary Steelman, thanks for adding the timestamp preservation feature in distcp. HDFS-9638 added timestamp preservation doc but it's not yet in Hadoop 2.7.2.

          Show
          jojochuang Wei-Chiu Chuang added a comment - Hi Gary Steelman , thanks for adding the timestamp preservation feature in distcp. HDFS-9638 added timestamp preservation doc but it's not yet in Hadoop 2.7.2.
          Hide
          ajisakaa Akira Ajisaka added a comment -

          Hi Wei-Chiu Chuang, do you think HDFS-9638 should be backported to branch-2.7?

          Show
          ajisakaa Akira Ajisaka added a comment - Hi Wei-Chiu Chuang , do you think HDFS-9638 should be backported to branch-2.7?
          Hide
          jojochuang Wei-Chiu Chuang added a comment -

          Hi Akira Ajisaka,
          I'm not sure about upstream versioning, but one of the parameter mentioned in HDFS-9638 was implemented in HADOOP-11827 and is part of 2.8.0. I can definitely do a branch-2.7 only patch though.

          Show
          jojochuang Wei-Chiu Chuang added a comment - Hi Akira Ajisaka , I'm not sure about upstream versioning, but one of the parameter mentioned in HDFS-9638 was implemented in HADOOP-11827 and is part of 2.8.0. I can definitely do a branch-2.7 only patch though.
          Hide
          ajisakaa Akira Ajisaka added a comment -

          Thank you Wei-Chiu Chuang! I would really appreciate if you could provide a patch for branch-2.7.

          Show
          ajisakaa Akira Ajisaka added a comment - Thank you Wei-Chiu Chuang ! I would really appreciate if you could provide a patch for branch-2.7.
          Hide
          jojochuang Wei-Chiu Chuang added a comment -

          Sure. I'm not sure where should I upload the patch, so I'll put it here.

          This is basically HDFS-9638 minus numListstatusThreads option in the docs. Thanks and please review.

          Show
          jojochuang Wei-Chiu Chuang added a comment - Sure. I'm not sure where should I upload the patch, so I'll put it here. This is basically HDFS-9638 minus numListstatusThreads option in the docs. Thanks and please review.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 22s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          +1 mvninstall 12m 28s branch-2.7 passed
          +1 compile 0m 16s branch-2.7 passed with JDK v1.8.0_74
          +1 compile 0m 18s branch-2.7 passed with JDK v1.7.0_95
          +1 checkstyle 0m 19s branch-2.7 passed
          +1 mvnsite 0m 26s branch-2.7 passed
          +1 mvneclipse 0m 54s branch-2.7 passed
          +1 findbugs 0m 37s branch-2.7 passed
          +1 javadoc 0m 15s branch-2.7 passed with JDK v1.8.0_74
          +1 javadoc 0m 16s branch-2.7 passed with JDK v1.7.0_95
          +1 mvninstall 0m 19s the patch passed
          +1 compile 0m 12s the patch passed with JDK v1.8.0_74
          +1 javac 0m 12s the patch passed
          +1 compile 0m 15s the patch passed with JDK v1.7.0_95
          +1 javac 0m 15s the patch passed
          +1 checkstyle 0m 13s the patch passed
          +1 mvnsite 0m 21s the patch passed
          +1 mvneclipse 0m 12s the patch passed
          -1 whitespace 0m 0s The patch has 1118 line(s) that end in whitespace. Use git apply --whitespace=fix.
          -1 whitespace 0m 28s The patch has 246 line(s) with tabs.
          +1 findbugs 0m 42s the patch passed
          +1 javadoc 0m 13s the patch passed with JDK v1.8.0_74
          +1 javadoc 0m 15s the patch passed with JDK v1.7.0_95
          +1 unit 8m 7s hadoop-distcp in the patch passed with JDK v1.8.0_74.
          +1 unit 7m 29s hadoop-distcp in the patch passed with JDK v1.7.0_95.
          -1 asflicense 0m 44s Patch generated 61 ASF License warnings.
          37m 9s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:c420dfe
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12792238/HDFS-9860.branch-2.7.001.patch
          JIRA Issue HDFS-9860
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 93eacc89e784 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision branch-2.7 / cff6db1
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14754/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14754/artifact/patchprocess/whitespace-tabs.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14754/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14754/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14754/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 22s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 12m 28s branch-2.7 passed +1 compile 0m 16s branch-2.7 passed with JDK v1.8.0_74 +1 compile 0m 18s branch-2.7 passed with JDK v1.7.0_95 +1 checkstyle 0m 19s branch-2.7 passed +1 mvnsite 0m 26s branch-2.7 passed +1 mvneclipse 0m 54s branch-2.7 passed +1 findbugs 0m 37s branch-2.7 passed +1 javadoc 0m 15s branch-2.7 passed with JDK v1.8.0_74 +1 javadoc 0m 16s branch-2.7 passed with JDK v1.7.0_95 +1 mvninstall 0m 19s the patch passed +1 compile 0m 12s the patch passed with JDK v1.8.0_74 +1 javac 0m 12s the patch passed +1 compile 0m 15s the patch passed with JDK v1.7.0_95 +1 javac 0m 15s the patch passed +1 checkstyle 0m 13s the patch passed +1 mvnsite 0m 21s the patch passed +1 mvneclipse 0m 12s the patch passed -1 whitespace 0m 0s The patch has 1118 line(s) that end in whitespace. Use git apply --whitespace=fix. -1 whitespace 0m 28s The patch has 246 line(s) with tabs. +1 findbugs 0m 42s the patch passed +1 javadoc 0m 13s the patch passed with JDK v1.8.0_74 +1 javadoc 0m 15s the patch passed with JDK v1.7.0_95 +1 unit 8m 7s hadoop-distcp in the patch passed with JDK v1.8.0_74. +1 unit 7m 29s hadoop-distcp in the patch passed with JDK v1.7.0_95. -1 asflicense 0m 44s Patch generated 61 ASF License warnings. 37m 9s Subsystem Report/Notes Docker Image:yetus/hadoop:c420dfe JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12792238/HDFS-9860.branch-2.7.001.patch JIRA Issue HDFS-9860 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 93eacc89e784 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2.7 / cff6db1 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14754/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14754/artifact/patchprocess/whitespace-tabs.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14754/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14754/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14754/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          jojochuang Wei-Chiu Chuang added a comment -

          All warnings are false positives, and unrelated to this patch.

          Show
          jojochuang Wei-Chiu Chuang added a comment - All warnings are false positives, and unrelated to this patch.
          Hide
          ajisakaa Akira Ajisaka added a comment -

          LGTM, +1.

          Show
          ajisakaa Akira Ajisaka added a comment - LGTM, +1.
          Hide
          ajisakaa Akira Ajisaka added a comment -

          Committed this to branch-2.7. Thanks Wei-Chiu Chuang for the contribution!

          Show
          ajisakaa Akira Ajisaka added a comment - Committed this to branch-2.7. Thanks Wei-Chiu Chuang for the contribution!
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          Closing the JIRA as part of 2.7.3 release.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - Closing the JIRA as part of 2.7.3 release.

            People

            • Assignee:
              jojochuang Wei-Chiu Chuang
              Reporter:
              gsteelman Gary Steelman
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development