Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17298

Require explicit CROSS join for cartesian products by default

    Details

    • Type: Story
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Require the use of CROSS join syntax in SQL (and a new crossJoin DataFrame API) to specify explicit cartesian products between relations under the default configuration (spark.sql.crossJoin.enabled = false).
      By cartesian product we mean a join between relations R and S where there is no join condition involving columns from both R and S.

      If a cartesian product is detected in the absence of an explicit CROSS join, an error must be thrown.
      Turning on the spark.sql.crossJoin.enabled configuration flag will disable this check and allow cartesian products without an explicit cross join.

        Attachments

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                vssrinath Srinath
                Reporter:
                vssrinath Srinath
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: