Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14557

Document HADOOP-8143 (Change distcp to have -pb on by default)

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha4
    • Fix Version/s: 3.0.0-beta1
    • Component/s: None
    • Labels:
      None

      Description

      HADOOP-8143 is an incompatible change. I think it deserves an update in the distcp doc.

      1. HADOOP-14557.02.patch
        2 kB
        Bharat Viswanadham
      2. HADOOP-14557.patch
        2 kB
        Bharat Viswanadham

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12041 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12041/)
          HADOOP-14557. Document HADOOP-8143 (Change distcp to have -pb on by (weichiu: rev 44350fdf495f5cf1bb15b1fe6f6e9587d3de0a59)

          • (edit) hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12041 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12041/ ) HADOOP-14557 . Document HADOOP-8143 (Change distcp to have -pb on by (weichiu: rev 44350fdf495f5cf1bb15b1fe6f6e9587d3de0a59) (edit) hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm
          Hide
          jojochuang Wei-Chiu Chuang added a comment -

          Thanks Bharat Viswanadham! Committed the 02 patch to trunk.

          Show
          jojochuang Wei-Chiu Chuang added a comment - Thanks Bharat Viswanadham ! Committed the 02 patch to trunk.
          Hide
          jojochuang Wei-Chiu Chuang added a comment -

          LGTM +1

          Show
          jojochuang Wei-Chiu Chuang added a comment - LGTM +1
          Hide
          hadoopqa Hadoop QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 16s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
                trunk Compile Tests
          +1 mvninstall 15m 12s trunk passed
          +1 mvnsite 0m 24s trunk passed
                Patch Compile Tests
          +1 mvnsite 0m 21s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
                Other Tests
          +1 asflicense 0m 19s The patch does not generate ASF License warnings.
          16m 55s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue HADOOP-14557
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12878213/HADOOP-14557.02.patch
          Optional Tests asflicense mvnsite
          uname Linux f25581603fd8 3.13.0-117-generic #164-Ubuntu SMP Fri Apr 7 11:05:26 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / c8df366
          modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12830/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       trunk Compile Tests +1 mvninstall 15m 12s trunk passed +1 mvnsite 0m 24s trunk passed       Patch Compile Tests +1 mvnsite 0m 21s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues.       Other Tests +1 asflicense 0m 19s The patch does not generate ASF License warnings. 16m 55s Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14557 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12878213/HADOOP-14557.02.patch Optional Tests asflicense mvnsite uname Linux f25581603fd8 3.13.0-117-generic #164-Ubuntu SMP Fri Apr 7 11:05:26 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / c8df366 modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12830/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          bharatviswa Bharat Viswanadham added a comment - - edited

          Wei-Chiu Chuang Ya got it. I think the update i have provided might provide some conflict. Updated the patch to mention it in a simple note as below.
          "*Note:* If -p option's are not specified, then by default block size is preserved."
          Let me know, if this is fine?

          Show
          bharatviswa Bharat Viswanadham added a comment - - edited Wei-Chiu Chuang Ya got it. I think the update i have provided might provide some conflict. Updated the patch to mention it in a simple note as below. "* Note: * If -p option's are not specified, then by default block size is preserved." Let me know, if this is fine?
          Hide
          jojochuang Wei-Chiu Chuang added a comment -

          Hi Bharat Viswanadham thanks for the patch.
          I want to clarify one thing: block size is preserved if -p options are not specified. However, if -p options are specified, block size is preserved only if -pb is specified. So it's not always enabled. Does that make sense to you?

          Show
          jojochuang Wei-Chiu Chuang added a comment - Hi Bharat Viswanadham thanks for the patch. I want to clarify one thing: block size is preserved if -p options are not specified. However, if -p options are specified, block size is preserved only if -pb is specified. So it's not always enabled. Does that make sense to you?
          Hide
          hadoopqa Hadoop QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 13s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
                trunk Compile Tests
          +1 mvninstall 13m 14s trunk passed
          +1 mvnsite 0m 20s trunk passed
                Patch Compile Tests
          +1 mvnsite 0m 17s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
                Other Tests
          +1 asflicense 0m 17s The patch does not generate ASF License warnings.
          14m 42s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue HADOOP-14557
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12878081/HADOOP-14557.patch
          Optional Tests asflicense mvnsite
          uname Linux 502f3636b2b5 3.13.0-117-generic #164-Ubuntu SMP Fri Apr 7 11:05:26 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / c21c260
          modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12827/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       trunk Compile Tests +1 mvninstall 13m 14s trunk passed +1 mvnsite 0m 20s trunk passed       Patch Compile Tests +1 mvnsite 0m 17s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues.       Other Tests +1 asflicense 0m 17s The patch does not generate ASF License warnings. 14m 42s Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14557 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12878081/HADOOP-14557.patch Optional Tests asflicense mvnsite uname Linux 502f3636b2b5 3.13.0-117-generic #164-Ubuntu SMP Fri Apr 7 11:05:26 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / c21c260 modules C: hadoop-tools/hadoop-distcp U: hadoop-tools/hadoop-distcp Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12827/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          bharatviswa Bharat Viswanadham added a comment -

          Wei-Chiu Chuang Uploaded the documentation change for this patch.
          Could you take a look at the patch?

          Show
          bharatviswa Bharat Viswanadham added a comment - Wei-Chiu Chuang Uploaded the documentation change for this patch. Could you take a look at the patch?

            People

            • Assignee:
              bharatviswa Bharat Viswanadham
              Reporter:
              jojochuang Wei-Chiu Chuang
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development