[SPARK-21333] joinWith documents and analysis allow invalid join types

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.1, 2.2.0
• Fix Version/s: 2.2.1, 2.3.0
• Component/s: Documentation
• Assignee: Corey Woodfield
• Reporter: Corey Woodfield
• Created: 07/Jul/17 00:03
• Updated: 14/Dec/20 17:49
• Resolved: 19/Jul/17 22:23

Description

joinWith returns a Dataset<Tuple2>, but left_semi and left_anti (which only return things from one side of the join) are listed as acceptable join types in the documentation, and an error is not thrown until spark gets to the joining part, rather than in the analysis phase. These join types should be removed from the documentation, and this error should be caught earlier

Issue Links

• relates to: SPARK-33778 Allow typesafe join for LeftSemi and LeftAnti
• links to: [Github] Pull Request #18462 (coreywoodfield)