Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-7545

[umbrella] Data striping support in HDFS client

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • None
    • None

    Description

      Data striping is a commonly used data layout with critical benefits in the context of erasure coding. This JIRA aims to extend HDFS client to work with striped blocks.

      Attachments

        1. HDFS-7545-001-DFSOutputStream.patch
          33 kB
          Li Bo
        2. clientStriping.patch
          50 kB
          Li Bo
        3. HDFS-7545-PoC.patch
          11 kB
          Zhe Zhang
        4. DataStripingSupportinHDFSClient.pdf
          309 kB
          Zhe Zhang

        Issue Links

          incorporates

          Sub-task - The sub-task of the issue HDFS-7672 Erasure Coding: consolidate streamer coordination logic and handle failure when writing striped blocks

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7678 Erasure coding: DFSInputStream with decode functionality (pread)

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7729 Add logic to DFSOutputStream to support writing a file in striping layout

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7782 Erasure coding: pread from files in striped layout

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8033 Erasure coding: stateful (non-positional) read from files in striped layout

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8203 Erasure Coding: Seek and other Ops in DFSStripedInputStream.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              libo-intel Li Bo
              zhz Zhe Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: