Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-9113

ErasureCodingWorker#processErasureCodingTasks should not fail to process remaining tasks due to one invalid ECTask

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: HDFS-7285
    • Fix Version/s: HDFS-7285
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently processErasureCodingTasks method submits ecTasks to thread pool service for processing the tasks. While submitting we initialize ReconstructAndTransferBlock with each ecTask and submit it. There are chances ReconstructAndTransferBlock initialization can fail due to wrong values as we had preconditions for parameter validations in Ctor. Anyway, whatever may be the case, processErasureCodingTasks should not fail and throw exceptions out as it could prevent processing other tasks in the list.

        Attachments

        1. HDFS-9113-HDFS-7285-00.patch
          5 kB
          Uma Maheswara Rao G

          Activity

            People

            • Assignee:
              umamaheswararao Uma Maheswara Rao G
              Reporter:
              umamaheswararao Uma Maheswara Rao G
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: