[DRILL-1465] Partition filter pushdown not happening for EasyGroupScan

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.5.0
• Fix Version/s: 0.6.0
• Component/s: Query Planning & Optimization
• Assignee: DrillCommitter
• Reporter: Aman Sinha
• Created: 29/Sep/14 17:49
• Updated: 01/Oct/14 23:38
• Resolved: 01/Oct/14 23:38

Description

For EasyGroupScan that handles Json and Text formats, we are not getting the directory partition filters pushed down into the Scan. One part of the reason is that the EasyGroupScan digest for a new scan that has a smaller selection of files is currently the same as the previous scan, so the planner ignores the new scan.

A second related issue is that the Filter can appear above either a Scan or a Project, so we need to be able to handle both cases during pushdown.