Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35553 Improve correlated subqueries
  3. SPARK-36124

Support set operators to be on correlation paths

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.4.0
    • SQL
    • None

    Description

      A correlation path is defined as the sub-tree of all the operators that are on the path from the operator hosting the correlated expressions up to the operator producing the correlated values. 

      We want to support set operators such as union and intercept to be on correlation paths by adding them in DecorrelateInnerQuery. Please see page 391 for more details: https://dl.gi.de/bitstream/handle/20.500.12116/2418/383.pdf 

      Attachments

        Activity

          People

            allisonwang-db Allison Wang
            allisonwang-db Allison Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: