[SPARK-12849] Bucketing improvements follow-up

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Later
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Reynold Xin
• Created: 16/Jan/16 01:22
• Updated: 29/Apr/16 21:43
• Resolved: 29/Apr/16 21:43

Description

This is a follow-up ticket for SPARK-12538 to improvement bucketing support.

Issue Links

• is blocked by: SPARK-12538 bucketed table support

Sub-Tasks

• Support bucket pruning (predicate pushdown for bucketed tables): Resolved
• Add the ability to understand tables bucketed by Hive: Resolved
• Support create table DDL with bucketing: Resolved
• Update query planner to use only bucketed reads if it is useful: Resolved
• Improve bucket read path to only create one single RDD: Resolved