Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8669

Erasure Coding: handle missing internal block locations in DFSStripedInputStream

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-7285
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently DFSStripedInputStream assumes we always have complete internal block location information, i.e., we can always get all the DataNodes for a striped block group. In a lot of scenarios the client cannot get complete block location info, e.g., some internal blocks are missing and the NameNode has not finished the recovery yet. We should add functionality to handle missing block locations in DFSStripedInputStream.

        Attachments

        1. HDFS-8669.000.patch
          38 kB
          Jing Zhao
        2. HDFS-8669.001.patch
          45 kB
          Jing Zhao
        3. HDFS-8669-HDFS-7285.001.patch
          45 kB
          Walter Su

          Issue Links

            Activity

              People

              • Assignee:
                jingzhao Jing Zhao
                Reporter:
                jingzhao Jing Zhao
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: