[DRILL-6105] SYSTEM ERROR: NullPointerException

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 1.12.0
• Fix Version/s: 1.20.0
• Component/s: Execution - Flow
• Assignee: James Turton
• Reporter: Nitin Pawar
• Created: 24/Jan/18 18:03
• Updated: 18/Jan/22 14:31
• Resolved: 18/Jan/22 14:31

Description

We just upgraded drill from 1.8.0 to 1.12.0

One of the issue which left us behind was whenever we upgraded Drill we were hit will null pointer exception in scenario which we could not spend time debugging. Then we rolled back to 1.8.0

This time we have spent some time and understood the problem

 

data set: 3 million records

5 columns, 2 of which are date columns (Let us call these date columns as A and B)

In column B majority of the values are nulls (roughly 99.5%)

our query is select * from table where A = B

above query fails with null pointer exception where the number of underlying parquet files are more than 1. If I merge the underlying parquet files into a single large file then we do not see this issue. 

We also were able to remove the error if we changed the where clause with coalesce(A,null) = coalesce(B,null)

This somehow points us that the error is coming while reading the parquet files with the given data types.

 

Issue Links

• duplicates: DRILL-8023 Empty dict page breaks the "old" Parquet reader