[HIVE-8740] Sorted dynamic partition does not work correctly with constant folding

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 0.14.0
• Assignee: Prasanth Jayachandran
• Reporter: Prasanth Jayachandran
• Created: 05/Nov/14 07:05
• Updated: 01/Oct/19 22:07
• Resolved: 06/Nov/14 00:38

Description

Sorted dynamic partition optimization looks for partition columns from the operator above FileSinkOperator. As per hive convention it expects partition columns at the last. But with HIVE-8585 equality filters on partition columns gets folded to constant. The column pruner then prunes the constant expression as they don't reference any columns. This in some cases will yield unexpected results (throw ArrayIndexOutOfBounds exception) with sorted dynamic partition insert optimization. In such cases we don't really need sorted dynamic partition optimization.

Issue Links

• links to: Review Board