[HIVE-24384] SharedWorkOptimizer improvements

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Zoltan Haindrich
• Reporter: Zoltan Haindrich
• Created: 13/Nov/20 10:21
• Updated: 13/Nov/20 10:21

Description

this started as a small feature addition but due to the sheer volume of the q.out changes - its better to do smaller changes at a time; which means more tickets...

Sub-Tasks

• Enhance shared work optimizer to merge scans with filters on both sides: Resolved
• SharedWorkOptimizer may create incorrect plans with DPPUnion: Resolved
• Implement hashCode and equals for Partition: Resolved
• Exchange SWO table/algorithm strategy: Resolved
• SWO should not create complex and redundant filter expressions: Resolved
• Enable SharedWorkOptimizer to merge downstream operators after an optimization step: Resolved
• Enhance swo optimizations to merge EventOperators: Resolved
• Enhance shared work optimizer to allow parallel edges: Resolved
• Add feature toggle to control SWO parallel edge support: Resolved
• Apply schema merge to all shared work optimizations: Resolved
• Relax safety checks in SharedWorkOptimizer: Open
• Organize replaceTabAlias methods: Open
• In SharedWorkOptimizer run simplification after merging TS filter expressions: Open
• SharedWorkOptimizer may retain the SJ filter condition during RemoveSemijoin mode: Open
• Disable sharedworkoptimizer remove semijoin by default: Open
• Restrict parallel edge creation for invertable RS operators: Resolved