Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-11939

Ozone : add read/write random access to Chunks of a key

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • ozone

    Description

      In Ozone, the value of a key is a sequence of container chunks. Currently, the only way to read/write the chunks is by using ChunkInputStream and ChunkOutputStream. However, by the nature of streams, these classes are currently implemented to only allow sequential read/write.

      Ideally we would like to support random access of the chunks. For example, we want to be able to seek to a specific offset and read/write some data. This will be critical for key range read/write feature, and potentially important for supporting parallel read/write.

      This JIRA tracks adding support by implementing FileChannel class on top Chunks.

      Attachments

        1. HDFS-11939-HDFS-7240.001.patch
          42 kB
          Chen Liang
        2. HDFS-11939-HDFS-7240.002.patch
          42 kB
          Chen Liang
        3. HDFS-11939-HDFS-7240.003.patch
          42 kB
          Chen Liang
        4. HDFS-11939-HDFS-7240.004.patch
          43 kB
          Chen Liang

        Activity

          People

            vagarychen Chen Liang
            vagarychen Chen Liang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: