Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-9261

Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      DFSStripedOutputStream will continue writing with minimum number (dataBlockNum) of live datanodes. It won't replace the failed datanodes immediately for the current block group. Consider a case where all the parity data streamers are failed, now it is unnecessary to encode the data block cells and generate the parity data. This is a corner case where it can skip writeParityCells() step.

      Attachments

        1. HDFS-9261-00.patch
          1 kB
          Rakesh Radhakrishnan
        2. HDFS-9261-01.patch
          2 kB
          Rakesh Radhakrishnan
        3. HDFS-9261-02.patch
          2 kB
          Rakesh Radhakrishnan

        Activity

          People

            rakeshr Rakesh Radhakrishnan
            rakeshr Rakesh Radhakrishnan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: