Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10298

Document the usage of distcp -diff option

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Distcp -diff options is currently documented as "Use snapshot diff report to identify the difference between source and target.", but the usage is not documented.

      1. HDFS-10298.1.patch
        2 kB
        Takashi Ohnishi
      2. HDFS-10298.2.patch
        2 kB
        Takashi Ohnishi

        Activity

        Hide
        bwtakacy Takashi Ohnishi added a comment -

        Hi!

        I have created a patch for this.
        In the attached patch, I have added the notation about arguments for -diff option and the preconditions for this feature which are mentioned in the top comments in DistCpSync.java.

        Show
        bwtakacy Takashi Ohnishi added a comment - Hi! I have created a patch for this. In the attached patch, I have added the notation about arguments for -diff option and the preconditions for this feature which are mentioned in the top comments in DistCpSync.java.
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvninstall 7m 4s trunk passed
        +1 mvnsite 0m 22s trunk passed
        +1 mvnsite 0m 20s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 asflicense 0m 17s Patch does not generate ASF License warnings.
        8m 34s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:fbe3e86
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799136/HDFS-10298.1.patch
        JIRA Issue HDFS-10298
        Optional Tests asflicense mvnsite
        uname Linux a8798a36aa50 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / fdc46bf
        modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15181/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvninstall 7m 4s trunk passed +1 mvnsite 0m 22s trunk passed +1 mvnsite 0m 20s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 asflicense 0m 17s Patch does not generate ASF License warnings. 8m 34s Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12799136/HDFS-10298.1.patch JIRA Issue HDFS-10298 Optional Tests asflicense mvnsite uname Linux a8798a36aa50 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / fdc46bf modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15181/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        Thanks Takashi Ohnishi for the patch. Two minor comments:
        1. Would you document that "-diff is valid only with -update option"?
        2. The following condition -> The following conditions

        Show
        ajisakaa Akira Ajisaka added a comment - Thanks Takashi Ohnishi for the patch. Two minor comments: 1. Would you document that "-diff is valid only with -update option"? 2. The following condition -> The following conditions
        Hide
        bwtakacy Takashi Ohnishi added a comment -

        Thanks Akira Ajisaka for your comments !

        I have fixed in the updated patch.

        Show
        bwtakacy Takashi Ohnishi added a comment - Thanks Akira Ajisaka for your comments ! I have fixed in the updated patch.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        +1 pending Jenkins. Manually triggered Jenkins precommit build: https://builds.apache.org/job/PreCommit-HDFS-Build/15273/

        Show
        ajisakaa Akira Ajisaka added a comment - +1 pending Jenkins. Manually triggered Jenkins precommit build: https://builds.apache.org/job/PreCommit-HDFS-Build/15273/
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvninstall 7m 6s trunk passed
        +1 mvnsite 0m 22s trunk passed
        +1 mvnsite 0m 20s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 asflicense 0m 17s Patch does not generate ASF License warnings.
        8m 35s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:fbe3e86
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12800363/HDFS-10298.2.patch
        JIRA Issue HDFS-10298
        Optional Tests asflicense mvnsite
        uname Linux 571132aec391 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / c282a08
        modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15273/console
        Powered by Apache Yetus 0.2.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvninstall 7m 6s trunk passed +1 mvnsite 0m 22s trunk passed +1 mvnsite 0m 20s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 asflicense 0m 17s Patch does not generate ASF License warnings. 8m 35s Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12800363/HDFS-10298.2.patch JIRA Issue HDFS-10298 Optional Tests asflicense mvnsite uname Linux 571132aec391 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / c282a08 modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15273/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        Committed this to branch-2.8 and above. Thanks Takashi Ohnishi for the contribution.

        Show
        ajisakaa Akira Ajisaka added a comment - Committed this to branch-2.8 and above. Thanks Takashi Ohnishi for the contribution.
        Hide
        bwtakacy Takashi Ohnishi added a comment -

        Thank you Akira Ajisaka for reviewing and committing

        Show
        bwtakacy Takashi Ohnishi added a comment - Thank you Akira Ajisaka for reviewing and committing
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #9663 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9663/)
        HDFS-10298. Document the usage of distcp -diff option. Contributed by (aajisaka: rev 02c51c27d92e74be7089083555e85da0e73f7fda)

        • hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9663 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9663/ ) HDFS-10298 . Document the usage of distcp -diff option. Contributed by (aajisaka: rev 02c51c27d92e74be7089083555e85da0e73f7fda) hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm

          People

          • Assignee:
            bwtakacy Takashi Ohnishi
            Reporter:
            ajisakaa Akira Ajisaka
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development