[HUDI-558] Introduce ability to compress bloom filters while storing in parquet

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: index, performance
• Labels: pull-request-available
• Assignee: liwei
• Reporter: Balaji Varadarajan
• Created: 19/Jan/20 11:54
• Updated: 07/Oct/21 23:25

Description

Based on performance study https://docs.google.com/spreadsheets/d/1KCmmdgaFTWBmpOk9trePdQ2m6wPVj2G328fTcRnQP1M/edit?usp=sharing we found that there is benefit in compressing bloom filters when storing in parquet. As this is an experimental feature, we will need to disable this feature by default.

Issue Links

• links to: GitHub Pull Request #1253