Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Duplicate
-
1.6.2
-
None
-
None
Description
EnsureRequirements compares the required and given sort ordering, but uses Scala equals instead of a semantic equals, so column capitalization isn't considered, and also fails for a cached table. This results in a SortMergeJoin of a cached already-sorted table to add an extra sort.
Attachments
Issue Links
- duplicates
-
SPARK-17271 Planner adds un-necessary Sort even if child ordering is semantically same as required ordering
- Resolved
- links to