[DRILL-5374] Parquet filter pushdown does not prune partition with nulls when predicate uses float column

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.9.0
• Component/s: Query Planning & Optimization
• Assignee: Jinfeng Ni
• Reporter: Robert Hou
• Reviewer: Robert Hou
• Created: 22/Mar/17 00:45
• Updated: 22/Mar/17 00:48

Description

Drill does not prune enough partitions for this query when filter pushdown is used with metadata caching. The float column is being compared with a double value.

0: jdbc:drill:zk=10.10.100.186:5181/drill/rho> select count(*) from orders_parts_metadata where float_id < 1100.0;

To reproduce the problem, put the attached files into a directory. Then

create the metadata:
refresh table metadata dfs.`path_to_directory`;

For example, if you put the files in /drill/testdata/filter/orders_parts_metadata, then run this sql command

refresh table metadata dfs.`/drill/testdata/filter/orders_parts_metadata`;