Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3689

Add support for variable length block

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.7.0
    • Component/s: datanode, hdfs-client, namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      1. HDFS now can choose to append data to a new block instead of end of the last partial block. Users can pass {{CreateFlag.APPEND}} and {{CreateFlag.NEW_BLOCK}} to the {{append}} API to indicate this requirement.
      2. HDFS now allows users to pass {{SyncFlag.END_BLOCK}} to the {{hsync}} API to finish the current block and write remaining data to a new block.
      Show
      1. HDFS now can choose to append data to a new block instead of end of the last partial block. Users can pass {{CreateFlag.APPEND}} and {{CreateFlag.NEW_BLOCK}} to the {{append}} API to indicate this requirement. 2. HDFS now allows users to pass {{SyncFlag.END_BLOCK}} to the {{hsync}} API to finish the current block and write remaining data to a new block.

      Description

      Currently HDFS supports fixed length blocks. Supporting variable length block will allow new use cases and features to be built on top of HDFS.

        Attachments

        1. HDFS-3689.000.patch
          74 kB
          Jing Zhao
        2. HDFS-3689.001.patch
          88 kB
          Jing Zhao
        3. HDFS-3689.002.patch
          100 kB
          Jing Zhao
        4. HDFS-3689.003.patch
          112 kB
          Jing Zhao
        5. HDFS-3689.003.patch
          112 kB
          Jing Zhao
        6. HDFS-3689.004.patch
          114 kB
          Jing Zhao
        7. HDFS-3689.005.patch
          113 kB
          Jing Zhao
        8. HDFS-3689.006.patch
          119 kB
          Jing Zhao
        9. HDFS-3689.007.patch
          121 kB
          Jing Zhao
        10. HDFS-3689.008.patch
          167 kB
          Jing Zhao
        11. HDFS-3689.008.patch
          167 kB
          Jing Zhao
        12. HDFS-3689.009.patch
          170 kB
          Jing Zhao
        13. editsStored
          6 kB
          Jing Zhao
        14. HDFS-3689.009.patch
          169 kB
          Jing Zhao
        15. HDFS-3689.010.patch
          170 kB
          Jing Zhao
        16. HDFS-3689.branch-2.patch
          169 kB
          Jing Zhao

          Issue Links

            Activity

              People

              • Assignee:
                jingzhao Jing Zhao
                Reporter:
                sureshms Suresh Srinivas
              • Votes:
                1 Vote for this issue
                Watchers:
                40 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: