Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3689

Add support for variable length block

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.7.0
    • datanode, hdfs-client, namenode
    • None
    • Reviewed
    • Hide
      1. HDFS now can choose to append data to a new block instead of end of the last partial block. Users can pass {{CreateFlag.APPEND}} and {{CreateFlag.NEW_BLOCK}} to the {{append}} API to indicate this requirement.
      2. HDFS now allows users to pass {{SyncFlag.END_BLOCK}} to the {{hsync}} API to finish the current block and write remaining data to a new block.
      Show
      1. HDFS now can choose to append data to a new block instead of end of the last partial block. Users can pass {{CreateFlag.APPEND}} and {{CreateFlag.NEW_BLOCK}} to the {{append}} API to indicate this requirement. 2. HDFS now allows users to pass {{SyncFlag.END_BLOCK}} to the {{hsync}} API to finish the current block and write remaining data to a new block.

    Description

      Currently HDFS supports fixed length blocks. Supporting variable length block will allow new use cases and features to be built on top of HDFS.

      Attachments

        1. HDFS-3689.branch-2.patch
          169 kB
          Jing Zhao
        2. HDFS-3689.010.patch
          170 kB
          Jing Zhao
        3. HDFS-3689.009.patch
          170 kB
          Jing Zhao
        4. HDFS-3689.009.patch
          169 kB
          Jing Zhao
        5. HDFS-3689.008.patch
          167 kB
          Jing Zhao
        6. HDFS-3689.008.patch
          167 kB
          Jing Zhao
        7. HDFS-3689.007.patch
          121 kB
          Jing Zhao
        8. HDFS-3689.006.patch
          119 kB
          Jing Zhao
        9. HDFS-3689.005.patch
          113 kB
          Jing Zhao
        10. HDFS-3689.004.patch
          114 kB
          Jing Zhao
        11. HDFS-3689.003.patch
          112 kB
          Jing Zhao
        12. HDFS-3689.003.patch
          112 kB
          Jing Zhao
        13. HDFS-3689.002.patch
          100 kB
          Jing Zhao
        14. HDFS-3689.001.patch
          88 kB
          Jing Zhao
        15. HDFS-3689.000.patch
          74 kB
          Jing Zhao
        16. editsStored
          6 kB
          Jing Zhao

        Issue Links

          Activity

            People

              jingzhao Jing Zhao
              sureshms Suresh Srinivas
              Votes:
              1 Vote for this issue
              Watchers:
              41 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: