Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-6462

Phase II : Erasure Coding Offline Recovery & Read/Write Improvements

    XMLWordPrintableJSON

Details

    • Epic
    • Status: Resolved
    • Major
    • Resolution: Implemented
    • None
    • 1.4.0
    • None
    • None

    Description

      This is an umbrella Jira for EC offline recovery work.

      As part of Phase-I, we have finished the functionality of erasure coding write and reads as part of the Jira HDDS-3816. That being stabilized in a parallel effort. 

      So, this Jira to start pending recovery work to finish end-end EC MVP.

      Requirements in brief: 

      1. The SCM to identify the lost containers and schedule for the reconstructions.
      2. DNs to start reconstructing the containers upon the request from DN.
      3. We can decide whether we create new RM at SCM for EC work or we just reuse existing one. Currently there are interest to start a new RM to start it clean as the existing one already complex enough.
      4. DNs to figure out the blocks them self by interacting with multiple EC block containers as single EC container may not have full set of blocks. Either first container or parity containers should have full block set. 

      I am splitting the offline recovery part of design from HDDS-3816 and post here soon.

      Stay tuned for the updated doc.

      We will also create new branch for this work in some time 

      Attachments

        Issue Links

          is a parent of

          Task - A task that needs to be done. HDDS-7661 Ratis Misreplication Handler

          • Major - Major loss of function.
          • Resolved
          is part of

          New Feature - A new feature of the product, which has yet to be developed. HDDS-3816 Erasure Coding

          • Major - Major loss of function.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. HDDS-8926 Umbrella for further EC improvements

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDDS-7838 gRPC channel created for block input/output stream not shutdown properly

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          split to

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-7759 Improve Ozone Replication Manager

          • Major - Major loss of function.
          • Resolved
          There are no Sub-Tasks for this issue.

          Activity

            People

              Unassigned Unassigned
              umamaheswararao Uma Maheswara Rao G
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: