Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-7545

[umbrella] Data striping support in HDFS client

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • None
    • None

    Description

      Data striping is a commonly used data layout with critical benefits in the context of erasure coding. This JIRA aims to extend HDFS client to work with striped blocks.

      Attachments

        1. clientStriping.patch
          50 kB
          Li Bo
        2. DataStripingSupportinHDFSClient.pdf
          309 kB
          Zhe Zhang
        3. HDFS-7545-001-DFSOutputStream.patch
          33 kB
          Li Bo
        4. HDFS-7545-PoC.patch
          11 kB
          Zhe Zhang

        Issue Links

          incorporates

          Sub-task - The sub-task of the issue HDFS-7672 Erasure Coding: consolidate streamer coordination logic and handle failure when writing striped blocks

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7678 Erasure coding: DFSInputStream with decode functionality (pread)

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7729 Add logic to DFSOutputStream to support writing a file in striping layout

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-7782 Erasure coding: pread from files in striped layout

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8033 Erasure coding: stateful (non-positional) read from files in striped layout

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-8203 Erasure Coding: Seek and other Ops in DFSStripedInputStream.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              libo-intel Li Bo
              zhz Zhe Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: