[DRILL-4072] Hive partition pruning not working with avro serde's

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.3.0
• Component/s: Storage - Avro
• Assignee: Unassigned
• Reporter: Rahul Kumar Challapalli
• Created: 11/Nov/15 18:58
• Updated: 06/Mar/18 19:41

Description

git.commit.id.abbrev=e78e286

The below plan indicates that partition pruning is not happening

explain plan for select * from hive.episodes_partitioned where doctor > 4;
+------+------+
| text | json |
+------+------+
| 00-00    Screen
00-01      Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
00-02        Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
00-03          SelectionVectorRemover
00-04            Filter(condition=[>($2, 4)])
00-05              Scan(groupscan=[HiveScan [table=Table(dbName:default, tableName:episodes_partitioned), inputSplits=[maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=1/000000_0:0+367, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=11/000000_0:0+393, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=2/000000_0:0+371, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=4/000000_0:0+368, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=5/000000_0:0+357, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=6/000000_0:0+370, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=9/000000_0:0+350], columns=[`*`], numPartitions=7, partitions= [Partition(values:[1]), Partition(values:[11]), Partition(values:[2]), Partition(values:[4]), Partition(values:[5]), Partition(values:[6]), Partition(values:[9])]]])

I attached the data file and the hql required. Let me know if anything else is needed