[HUDI-106] Dynamically tune bloom filter entries

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 0.5.1
• Component/s: index
• Labels: pull-request-available realtime-data-lakes
• Assignee: sivabalan narayanan
• Reporter: Vinoth Chandar
• Created: 25/Apr/19 18:48
• Updated: 03/Feb/20 01:51

Description

Tuning bloom filters is currently based on a configuration, that could be cumbersome to tune per dataset to obtain good indexing performance.. Lets add support for Dynamic Bloom Filters, that can automatically achieve a configured false positive ratio depending on number of entries. 

Issue Links

• links to: GitHub Pull Request #976