[DRILL-6331] Parquet filter pushdown does not support the native hive reader

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13.0
• Fix Version/s: 1.14.0
• Component/s: Storage - Hive
• Labels: doc-complete ready-to-commit
• Assignee: Arina Ielchiieva
• Reporter: Arina Ielchiieva
• Reviewer: Vitalii Diravka
• Created: 16/Apr/18 13:08
• Updated: 25/Jun/18 15:10
• Resolved: 27/Apr/18 09:43

Description

Initially HiveDrillNativeParquetGroupScan was based mainly on HiveScan, the core difference between them was
that HiveDrillNativeParquetScanBatchCreator was creating ParquetRecordReader instead of HiveReader.
This allowed to read Hive parquet files using Drill native parquet reader but did not expose Hive data to Drill optimizations.
For example, filter push down, limit push down, count to direct scan optimizations.
Hive code had to be refactored to use the same interfaces as ParquestGroupScan in order to be exposed to such optimizations.

Issue Links

• links to: GitHub Pull Request #1214