[DRILL-6342] Parquet filter pushdown doesn't work in case of filtering fields inside arrays of complex fields

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0
• Labels: ready-to-commit
• Assignee: Arina Ielchiieva
• Reporter: Anton Gozhiy
• Reviewer: Parth Chandra
• Created: 19/Apr/18 16:28
• Updated: 14/May/18 13:23
• Resolved: 27/Apr/18 09:45

Description

Data:
Complex_data data set is attached

Query:

explain plan for select * from dfs.tmp.`Complex_data` t where t.list_of_complex_fields[2].nested_field is true

Expected result:
numFiles=2
Statistics of the file that should't be scanned:

list_of_complex_fields:        
.nested_field:                   BOOLEAN UNCOMPRESSED DO:0 FPO:497 SZ:41/41/1.00 VC:3 ENC:PLAIN,RLE ST:[min: false, max: false, num_nulls: 0]

Actual result:
numFiles=3
I.e, filter pushdown is not work

Issue Links

• links to: GitHub Pull Request #1231