[HIVE-24384] SharedWorkOptimizer improvements

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 13/Nov/20 10:21
• Updated: 13/Nov/20 10:21

Description

this started as a small feature addition but due to the sheer volume of the q.out changes - its better to do smaller changes at a time; which means more tickets...

Sub-Tasks

• Enhance shared work optimizer to merge scans with filters on both sides: Closed
• SharedWorkOptimizer may create incorrect plans with DPPUnion: Closed
• Implement hashCode and equals for Partition: Closed
• Exchange SWO table/algorithm strategy: Closed
• SWO should not create complex and redundant filter expressions: Closed
• Enable SharedWorkOptimizer to merge downstream operators after an optimization step: Closed
• Enhance swo optimizations to merge EventOperators: Resolved
• Enhance shared work optimizer to allow parallel edges: Closed
• Add feature toggle to control SWO parallel edge support: Closed
• Apply schema merge to all shared work optimizations: Closed
• Disable sharedworkoptimizer remove semijoin by default: Closed
• Restrict parallel edge creation for invertable RS operators: Closed
• Relax safety checks in SharedWorkOptimizer: Open
• Organize replaceTabAlias methods: Open
• In SharedWorkOptimizer run simplification after merging TS filter expressions: Open
• SharedWorkOptimizer may retain the SJ filter condition during RemoveSemijoin mode: Open
• Parallel edge fixer may run into NPE when RS is missing a duplicate column from the output schema: Closed
• Parallel edge fixer may not be able to process semijoin edges: Closed