[IMPALA-2570] Insert into/overwrite [SHUFFLE] hint is not applied unless the partition is not specified

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Impala 2.2.4, impala 2.3
• Fix Version/s: Impala 2.7.0, Impala 2.6.2, Impala 2.5.4
• Component/s: Frontend
• Labels: ramp-up usability
• Target Version: Impala 2.7.0, Impala 2.6.2, Impala 2.5.4
• Assignee: Alexander Behm
• Reporter: Peter Ebert
• Created: 20/Oct/15 18:51
• Updated: 04/Jan/17 23:58
• Resolved: 31/Aug/16 13:36

Description

Queries that insert into partitions of the form:

insert overwrite table_name partition(p=2)
[shuffle]
select col1, col2 from table_name where p=1

or

insert overwrite table_name partition(p=1)
[shuffle]
select col1, col2, '2' as p from table_name where p=1

both have the [shuffle] hint ignored in the query plan. In order to get the shuffle hint to work you must use the following form

insert overwrite table_name partition(p)
[shuffle]
select col1, col2, '2' as p from table_name where p=1

which means you can't copy from one partition to another as the first two queries are.