[SPARK-12538] bucketed table support

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: SQL
• Target Version/s: 2.0.0
• Assignee: Wenchen Fan
• Reporter: Wenchen Fan
• Created: 28/Dec/15 13:54
• Updated: 16/Jan/16 01:22
• Resolved: 16/Jan/16 01:21

Description

cc nongli , please attach the design doc.

Issue Links

• blocks: SPARK-12849 Bucketing improvements follow-up
• is duplicated by: SPARK-12394 Support writing out pre-hash-partitioned data and exploit that in join optimizations to avoid shuffle (i.e. bucketing in Hive)

Sub-Tasks

• support writing bucketed table: Resolved
• support reading bucketed table: Resolved
• add Hash expression that can calculate hash value for a group of expressions: Resolved
• use hash expression in Exchange: Resolved