[HDDS-6806] EC: Implement the EC Reconstruction coordinator

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.3.0
• Component/s: Ozone Datanode
• Labels: pull-request-available
• Assignee: Uma Maheswara Rao G
• Reporter: Uma Maheswara Rao G
• Created: 26/May/22 06:42
• Updated: 21/Jul/22 12:46
• Resolved: 16/Jun/22 16:16

Description

This Jira implemented the reconstruction coordinator logic.

ECReconstruction coordinator re-uses the ECReconstructedStripedInputStream, ECBlockOutputStream and ContainerProcolCalls for reconstruction of a container.

Steps are a follows:

For a container reconstruction task, the main flow is:
  - ListBlock from all healthy replicas
  - calculate effective block group len for all blocks
  - create RECOVERING containers in TargetDNs
  -  for each block
  -    build a ECReconstructedStripedInputStream to read healthy chunks
  -    build a ECBlockOutputStream to write out decoded chunks
  -      for each stripe
  -        use ECReconstructedStripedInputStream.recoverChunks to decode chunks
  -        use ECBlockOutputStream.write to write decoded chunks to TargetDNs
  -    PutBlock
  - Close RECOVERING containers in TargetDNs

 

 

Issue Links

• links to: GitHub Pull Request #3467
• links to: GitHub Pull Request #3504