[SPARK-26599] BroardCast hint can not work with PruneFileSourcePartitions

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.4.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: eaton
• Created: 11/Jan/19 07:18
• Updated: 28/Feb/20 06:08
• Resolved: 18/Feb/19 06:13

Description

BroardCast hint can not work with `PruneFileSourcePartitions`, for example, when the filter condition p is a partition field, table b in SQL below cannot be broadcast.

` sql("select /*+ broadcastjoin(b) */ * from (select a from empty_test where p=1) a " +
"join (select a,b from par_1 where p=1) b on a.a=b.a").explain`

Issue Links

• duplicates: SPARK-26576 Broadcast hint not applied to partitioned table
• links to: GitHub Pull Request #23517