[HIVE-8640] Support hints of SMBJoin [Spark Branch]

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: spark-branch
• Fix Version/s: 1.1.0
• Component/s: Spark
• Labels: TODOC-SPARK TODOC15
• Assignee: Szehon Ho
• Reporter: Szehon Ho
• Created: 28/Oct/14 22:51
• Updated: 29/May/15 08:20
• Resolved: 20/Dec/14 14:56

Description

HIVE-8202 supports conversion of join to SMB Join automatically, which relies on the configuration property: "hive.auto.convert.sortmerge.join.bigtable.selection.policy".

This task is to support conversion based on map-hints, instead of this policy. As hints are deprecated, this would not be the primary policy in line with MapReduce, but can be available as a backup to achieve feature parity.

Issue Links

• is blocked by: HIVE-9177 Fix child operator references after NonBlockingOpDeDupProc (II)
• is depended upon by: HIVE-8431 Enable smb_mapjoin_11.q and smb_mapjoin_12.q [Spark Branch]
• is related to: HIVE-8911 Enable mapjoin hints [Spark Branch]
• relates to: HIVE-8202 Support SMB Join for Hive on Spark [Spark Branch]
• links to: review board