[HDDS-11014] [hsync] Block finalization should also merge last chunk to blockDataTable

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: HDDS-7593
• Labels: pull-request-available
• Assignee: Wei-Chiu Chuang
• Reporter: Wei-Chiu Chuang
• Created: 14/Jun/24 04:14
• Updated: 5 days ago 16:56
• Resolved: 25/Jun/24 17:42

Description

We designed a separate lastChunkInfoTable to record the last chunk of a block that may be rapidly updated by hsync.

That is causing a lot of problems because if a block is not longer than a full chunk, it would appear to be missing to other part of Ozone system, causing data loss.

 

We should merge the block data from lastChunkInfoTable to blockDataTable when the block is finalized. 

 

And also when end of block is reached.

Issue Links

• fixes: HDDS-11012 [Hbase-Ozone] HMaster down with NO_REPLICA_FOUND causing "CorruptHFileException: Problem reading HFile Trailer"
• is a child of: HDDS-9753 [hsync] Make Putblock performance acceptable - Tool cleanup, guardrails
• relates to: HDDS-11012 [Hbase-Ozone] HMaster down with NO_REPLICA_FOUND causing "CorruptHFileException: Problem reading HFile Trailer"
• links to: GitHub Pull Request #6847
• links to: RCA and fix descriptions