[DRILL-6350] Umbrella jira which tracks issues connected to Transitive Closure Inference

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Future
• Component/s: Query Planning & Optimization
• Assignee: Unassigned
• Reporter: Vitalii Diravka
• Created: 24/Apr/18 13:10
• Updated: 31/Oct/19 11:00

Description

Transitive closure is implemented with DRILL-6173 in Drill. But it doesn't work for some cases, these Calcite issues can resolve them:
CALCITE-1048, CALCITE-2274, CALCITE-2275, CALCITE-2241.

Transitive closure should work for the following cases (marked in code as ignore test cases):
https://github.com/apache/drill/blob/6fcaf4268eddcb09010b5d9c5dfb3b3be5c3f903/exec/java-exec/src/test/java/org/apache/drill/exec/store/parquet/TestParquetFilterPushdownWithTransitivePredicates.java#L178

Issue Links

• contains: CALCITE-1048 Make metadata more robust
• contains: DRILL-6465 Transitive closure is not working in Drill for Join with multiple local conditions
• contains: CALCITE-2275 Do not push down NOT condition in JOIN
• contains: CALCITE-2241 Join equality condition should be considered while pushing down filter conditions with expressions disjunction for both tables
• contains: CALCITE-2274 Filter predicates aren't inferred while using dynamic star in subquery
• Dependency: DRILL-6173 Support transitive closure during filter push down and partition pruning
• incorporates: DRILL-6589 Push transitive closure generated predicates past aggregates
• is related to: CALCITE-2296 Extra logic to derive additional filters in the FilterJoinRule