Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9541

Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.1
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: libhdfs
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We should have a new API in libhdfs which will support creating files with a default block size that is more than 31 bits in size. We should also make this a builder API so that it is easy to add more options later.

        Attachments

        1. HDFS-9541.001.patch
          8 kB
          Colin McCabe
        2. HDFS-9541.002.patch
          9 kB
          Colin McCabe

        Issue Links

        is duplicated by

        Bug - A problem which impairs or prevents the functions of the product. HDFS-8949 hdfsOpenFile() in HDFS C API does not support block sizes larger than 2GB

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDFS-9446 tSize of libhdfs in hadoop-2.7.1 is still int32_t

        • Major - Major loss of function.
        • Resolved

          Activity
          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              cmccabe Colin McCabe
              Reporter:
              cmccabe Colin McCabe

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment