[PARQUET-2484] Unable to create bloomfilter when writing duplicates values for a field

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 1.13.1
• Component/s: parquet-mr
• Assignee: Unassigned
• Reporter: Mahesh Pai
• Created: 28/May/24 10:45
• Updated: 23/Jun/24 03:33

Description

I'm unable to create a bloomfilter for a field, when I perform writes with repeating values. The bloomfilter returned is null when I try to read such a parquet file. If there are no repeating values, the bloomfilter is created without any issue.
The working and non-working case in captured in the below repo

https://github.com/MaheshGPai/parquet-mr-test
https://github.com/MaheshGPai/parquet-mr-test/blob/main/src/test/java/com/mahesh/test/AppTest.java#L73