[SPARK-18245] Improving support for bucketed table

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: SQL
• Labels: bulk-closed
• Target Version/s: 3.0.0
• Assignee: Unassigned Assign to me
• Reporter: Reynold Xin
• Created: 03/Nov/16 08:59
• Updated: 08/Oct/19 05:42
• Resolved: 08/Oct/19 05:42

Description

This is an umbrella ticket for improving various execution planning for bucketed tables.

Sub-Tasks

• Preserve order when scanning ordered buckets over multiple partitions: Resolved
• Use bucket files for TABLESAMPLE BUCKET: Resolved
• Filter operator should have “stop if false” semantics for sorted data: Resolved
• FileSourceScanExec to extract `outputOrdering` information: Resolved
• SortMergeJoin adds shuffle if join predicates have non partitioned columns: Resolved