Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-7678

Erasure coding: DFSInputStream with decode functionality (pread)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7285
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      A block group reader will read data from BlockGroup no matter in striping layout or contiguous layout. The corrupt blocks can be known before reading(told by namenode), or just be found during reading. The block group reader needs to do decoding work when some blocks are found corrupt.

      Attachments

        1. BlockGroupReader.patch
          26 kB
          Li Bo
        2. HDFS-7678.000.patch
          16 kB
          Zhe Zhang
        3. HDFS-7678.001.patch
          20 kB
          Zhe Zhang
        4. HDFS-7678-HDFS-7285.002.patch
          23 kB
          Zhe Zhang
        5. HDFS-7678-HDFS-7285.003.patch
          40 kB
          Zhe Zhang
        6. HDFS-7678-HDFS-7285.004.patch
          39 kB
          Zhe Zhang
        7. HDFS-7678-HDFS-7285.005.patch
          26 kB
          Zhe Zhang
        8. HDFS-7678-HDFS-7285.006.patch
          27 kB
          Zhe Zhang
        9. HDFS-7678-HDFS-7285.007.patch
          28 kB
          Zhe Zhang
        10. HDFS-7678-HDFS-7285.008.patch
          29 kB
          Zhe Zhang
        11. HDFS-7678-HDFS-7285.009.patch
          27 kB
          Zhe Zhang
        12. HDFS-7678-HDFS-7285.010.patch
          27 kB
          Zhe Zhang
        13. HDFS-7678-HDFS-7285.012.patch
          36 kB
          Zhe Zhang
        14. HDFS-7678-HDFS-7285.013.patch
          45 kB
          Zhe Zhang
        15. HDFS-7678-HDFS-7285.014.patch
          47 kB
          Zhe Zhang

        Issue Links

          is part of

          Sub-task - The sub-task of the issue HDFS-7545 [umbrella] Data striping support in HDFS client

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HDFS-7348 Erasure Coding: DataNode reconstruct striped blocks

          • Major - Major loss of function.
          • Resolved
          requires

          Sub-task - The sub-task of the issue HDFS-8334 Erasure coding: rename DFSStripedInputStream related test classes

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              zhz Zhe Zhang
              libo-intel Li Bo
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: