[HUDI-3488] The flink small file list should exclude file slices with pending compaction

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Component/s: compaction, flink, table-service
• Labels: flink hudi pull-request-available
• Assignee: Unassigned
• Reporter: yanenze

Reviewers

Danny Chen

• Created: 23/Feb/22 08:54
• Updated: 04/Sep/24 03:20
• Resolved: 04/Sep/24 03:20

Description

when we use async-compaction files with flink, bucketAssigner find small file list , is lost the file which is in pendingCompaction, so the total size only caculate the (log file size * compressratio (0.35))

Issue Links

• links to: GitHub Pull Request #4879
• links to: GitHub Pull Request #4893