Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1454

Update the documentation to reflect true client caching strategy

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2
    • Fix Version/s: 0.22.0
    • Component/s: documentation, hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      doc
    1. HDFS-1454.r1.diff
      4 kB
      Harsh J
    2. HDFS-1454-reop.r1.diff
      1 kB
      Harsh J
    3. HDFS-1454-reop.r1.diff
      1 kB
      Harsh J

      Activity

      Hide
      Harsh J added a comment -

      Initial docfix patch that gets rid of the staging talk.

      Show
      Harsh J added a comment - Initial docfix patch that gets rid of the staging talk.
      Hide
      Todd Lipcon added a comment -

      +1 pending Hudson. Thanks Harsh! It's amazing this inaccuracy has persisted for so many years.

      Show
      Todd Lipcon added a comment - +1 pending Hudson. Thanks Harsh! It's amazing this inaccuracy has persisted for so many years.
      Hide
      Hadoop QA added a comment -

      +1 overall. Here are the results of testing the latest attachment
      http://issues.apache.org/jira/secure/attachment/12481320/HDFS-1454.r1.diff
      against trunk revision 1130870.

      +1 @author. The patch does not contain any @author tags.

      +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

      +1 javadoc. The javadoc tool did not generate any warning messages.

      +1 javac. The applied patch does not increase the total number of javac compiler warnings.

      +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

      +1 release audit. The applied patch does not increase the total number of release audit warnings.

      +1 core tests. The patch passed core unit tests.

      +1 contrib tests. The patch passed contrib unit tests.

      +1 system test framework. The patch passed system test framework compile.

      Test results: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/700//testReport/
      Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/700//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
      Console output: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/700//console

      This message is automatically generated.

      Show
      Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12481320/HDFS-1454.r1.diff against trunk revision 1130870. +1 @author. The patch does not contain any @author tags. +0 tests included. The patch appears to be a documentation patch that doesn't require tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. +1 system test framework. The patch passed system test framework compile. Test results: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/700//testReport/ Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/700//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Console output: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/700//console This message is automatically generated.
      Hide
      Todd Lipcon added a comment -

      Committed to trunk and 22. Thanks Harsh.

      Show
      Todd Lipcon added a comment - Committed to trunk and 22. Thanks Harsh.
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-trunk-Commit #711 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/711/)
      HDFS-1454. Update the documentation to reflect that clients don't write blocks to local disk before copying to HDFS. Contributed by Harsh J Chouraria.

      todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1131223
      Files :

      • /hadoop/hdfs/trunk/src/docs/src/documentation/content/xdocs/hdfs_design.xml
      • /hadoop/hdfs/trunk/CHANGES.txt
      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #711 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/711/ ) HDFS-1454 . Update the documentation to reflect that clients don't write blocks to local disk before copying to HDFS. Contributed by Harsh J Chouraria. todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1131223 Files : /hadoop/hdfs/trunk/src/docs/src/documentation/content/xdocs/hdfs_design.xml /hadoop/hdfs/trunk/CHANGES.txt
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-trunk #688 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/688/)

      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #688 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/688/ )
      Hide
      Eli Collins added a comment -

      DataNode starts receiving the data in small portions (4 KB),

      Why 4k? DFS_CLIENT_WRITE_PACKET_SIZE_DEFAULT is 64k.

      Show
      Eli Collins added a comment - DataNode starts receiving the data in small portions (4 KB), Why 4k? DFS_CLIENT_WRITE_PACKET_SIZE_DEFAULT is 64k.
      Hide
      Harsh J added a comment -

      @Eli - Failed to actually verify the entire documents. Patch was intended to only remove staging, but I should've fixed other things as well I guess.

      Show
      Harsh J added a comment - @Eli - Failed to actually verify the entire documents. Patch was intended to only remove staging, but I should've fixed other things as well I guess.
      Hide
      Harsh J added a comment -

      Fix the default packet size.

      Show
      Harsh J added a comment - Fix the default packet size.
      Hide
      Todd Lipcon added a comment -

      hrm, since we already committed this a few days ago, can we actually open a new JIRA? seems easier to track, since this is a different issue elsewhere in the doc, right?

      Show
      Todd Lipcon added a comment - hrm, since we already committed this a few days ago, can we actually open a new JIRA? seems easier to track, since this is a different issue elsewhere in the doc, right?
      Hide
      Harsh J added a comment -

      Re-resolving per Todd's suggestion.

      Opened: HDFS-2036

      Show
      Harsh J added a comment - Re-resolving per Todd's suggestion. Opened: HDFS-2036
      Hide
      Hudson added a comment -

      Integrated in Hadoop-Hdfs-22-branch #61 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-22-branch/61/)

      Show
      Hudson added a comment - Integrated in Hadoop-Hdfs-22-branch #61 (See https://builds.apache.org/hudson/job/Hadoop-Hdfs-22-branch/61/ )

        People

        • Assignee:
          Harsh J
          Reporter:
          Jeff Hammerbacher
        • Votes:
          1 Vote for this issue
          Watchers:
          4 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development