Description
It seems we can remove Sort operator:
val projectPlan = testRelation.select($"a", $"b") val unnecessaryOrderByPlan = projectPlan.orderBy($"a".asc) val localLimitPlan = LocalLimit(Literal(2), unnecessaryOrderByPlan) val projectPlanB = testRelationB.select($"d") val joinPlan = localLimitPlan.join(projectPlanB, RightOuter).select($"a", $"d")
Attachments
Attachments
Issue Links
- is duplicated by
-
SPARK-40080 Adds additional EliminateSorts before LimitPushDown
- Resolved
- links to