[FLINK-26346] Add statistics collecting to sst files

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.0
• Fix Version/s: table-store-0.1.0
• Component/s: Table Store
• Labels: pull-request-available
• Assignee: Caizhi Weng
• Reporter: Caizhi Weng
• Created: 24/Feb/22 09:20
• Updated: 09/Mar/22 03:06
• Resolved: 09/Mar/22 03:06

Description

Currently field statistics are not collected in sst files. With statistics we can do filter and other operations with better performance.

Some formats like orc already record statistics into file headers, so for these special formats we just need to read them directly from files. For others, however, we need to collect the statistics by hand.

Issue Links

• links to: GitHub Pull Request #33