[PARQUET-2257] [Format] Add bloom_filter_length to ColumnMetaData

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: format-2.10.0
• Component/s: parquet-format
• Assignee: Gang Wu
• Reporter: Gang Wu
• Created: 13/Mar/23 15:08
• Updated: 15/Nov/23 15:23
• Resolved: 15/Apr/23 13:10

Description

The specs only has added bloom_filter_offset to locate the bloom filter. The reader cannot load the bloom filter in a single shot until it parses the bloom filter header to get the total size.
This issue proposes to add an optional bloom_filter_length field to track the size of bloom filter to facilitate I/O scheduling.