[DRILL-6856] Wrong result returned if the query filters a boolean column with both "is true" and "is null" conditions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.16.0
• Assignee: Igor Guzenko
• Reporter: Anton Gozhiy
• Reviewer: Vova Vysotskyi
• Created: 15/Nov/18 14:36
• Updated: 31/Jan/20 05:21
• Resolved: 02/Feb/19 10:45

Description

Data:
A parquet file with a boolean column that contains null values.
An example is attached.

Query:

select bool_col from dfs.tmp.`Test_data` where bool_col is true or bool_col is null

Result:

null
null

Plan:

00-00    Screen : rowType = RecordType(ANY bool_col): rowcount = 3.75, cumulative cost = {37.875 rows, 97.875 cpu, 15.0 io, 0.0 network, 0.0 memory}, id = 1980
00-01      Project(bool_col=[$0]) : rowType = RecordType(ANY bool_col): rowcount = 3.75, cumulative cost = {37.5 rows, 97.5 cpu, 15.0 io, 0.0 network, 0.0 memory}, id = 1979
00-02        SelectionVectorRemover : rowType = RecordType(ANY bool_col): rowcount = 3.75, cumulative cost = {33.75 rows, 93.75 cpu, 15.0 io, 0.0 network, 0.0 memory}, id = 1978
00-03          Filter(condition=[IS NULL($0)]) : rowType = RecordType(ANY bool_col): rowcount = 3.75, cumulative cost = {30.0 rows, 90.0 cpu, 15.0 io, 0.0 network, 0.0 memory}, id = 1977
00-04            Scan(table=[[dfs, tmp, Test_data]], groupscan=[ParquetGroupScan [entries=[ReadEntryWithPath [path=maprfs:///tmp/Test_data]], selectionRoot=maprfs:/tmp/Test_data, numFiles=1, numRowGroups=1, usedMetadataFile=false, columns=[`bool_col`]]]) : rowType = RecordType(ANY bool_col): rowcount = 15.0, cumulative cost = {15.0 rows, 15.0 cpu, 15.0 io, 0.0 network, 0.0 memory}, id = 1976

Notes:

• "true" values were not included in the result though they should have.
• Result is correct if use "bool_col = true" instead of "is true"
• In the plan you can see that "is true" condition is absent in the Filter operator