[HUDI-7549] Data inconsistency issue w/ spurious log block detection

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.15.0, 1.0.0
• Component/s: reader-core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: sivabalan narayanan
• Created: 25/Mar/24 18:13
• Updated: 05/Jun/24 00:53
• Resolved: 05/Jun/24 00:53

Description

We added support to deduce spurious log blocks with log block reader 

https://github.com/apache/hudi/pull/9545

https://github.com/apache/hudi/pull/9611 

in 0.14.0. 

Aparrently there are some cases where it could lead to data loss or data consistency issues. 

https://github.com/apache/hudi/pull/9611#issuecomment-2016687160 

Issue Links

• links to: GitHub Pull Request #10922