[PARQUET-645] DictionaryFilter incorrectly handles null

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.9.0, 1.8.2
• Component/s: parquet-mr
• Assignee: Ryan Blue
• Reporter: Ryan Blue
• Created: 28/Jun/16 03:18
• Updated: 23/Jun/24 03:28
• Resolved: 30/Jun/16 16:48

Description

DictionaryFilter checks whether a column can match a query and filters out row groups that can't match. Equality checks don't currently handle null correctly, which is never in the dictionary and is encoded by the definition level. This is causing row groups to be filtered when they should not be because "col is null" is always true.

Issue Links

• links to: PR #348