Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27741

Transitivity on predicate pushdown

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.1.1
    • Fix Version/s: 2.4.0
    • Component/s: SQL
    • Labels:
      None

      Description

      When using inner join, where conditions can be passed to join on, and when using outer join, even if the conditions are the same, only the predicate is pushed down to left or right.
      As follows:

      select * from t1 left join t2 on t1.id=t2.id where t1.id=1
      --> select * from t1 left join on t1.id=t2.id and t2.id=1 where t1.id=1

      Is Catalyst can support transitivity on predicate pushdown ?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                xyxiaoyou U Shaw
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: