[PARQUET-1787] Expected distinct numbers is not parsed correctly

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Component/s: parquet-mr
• Labels: pull-request-available
• Assignee: Walid Gara
• Reporter: Walid Gara
• Created: 05/Feb/20 23:00
• Updated: 23/Jun/24 03:31

Description

In the bloom filter feature, when I pass the expected distinct numbers as below, I got null values instead of 1000 and 200.

import org.apache.hadoop.conf.Configuration;

Configuration conf = new Configuration();

conf.set("parquet.bloom.filter.column.names", "content,line"); conf.set("parquet.bloom.filter.expected.ndv","1000,200");

 
The issue is coming from getting the system property of expected distinct numbers through Long.getLong(expectedNDVs[i]).

 

It's possible to fix it by parsing the string with Long.parseLong(expectedNDVs[i]).

 

Issue Links

• links to: GitHub Pull Request #753