Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-9829

Erasure Coding: Improve few exception handling logic of ErasureCodingWorker

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.0.0-alpha1
    • erasure-coding
    • None
    • Reviewed

    Description

      1. Cancel remaining reads on InterruptedException.
        	} catch (InterruptedException e) {
                  LOG.info("Read data interrupted.", e);
                  break;
                }
        
      2. Shouldn't fail recontruction due to an IOException errors while reporting corrupt blocks.
                  } finally {
                    // report corrupted blocks to NN
                    reportCorruptedBlocks(corruptionMap);
                  }
        
      3. ECW#closeBlockReader() function can be simplified using IOUtils.closeStream(closable)
      4. Also, use {} instead of string concatenation in logger.
        LOG.debug("Using striped reads; pool threads=" + num);
        //...
        LOG.warn("Found Checksum error for " + reader.block + " from "
                        + reader.source + " at " + e.getPos());
        //...
        LOG.debug("Using striped block reconstruction; pool threads=" + num);
        //..
        LOG.warn("Failed to reconstruct striped block: " + blockGroup, e);
        

      Attachments

        1. HDFS-9829-002.patch
          6 kB
          Rakesh Radhakrishnan
        2. HDFS-9829-001.patch
          7 kB
          Rakesh Radhakrishnan

        Activity

          People

            rakeshr Rakesh Radhakrishnan
            rakeshr Rakesh Radhakrishnan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: