Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13873

Avoid the copy in whole stage codegen when there is no joins

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: SQL
    • Labels:
      None

      Description

      When we generate code for join, we copy the output row, because there could be multiple output row from single input row.

      We could avoid this copy when there is no join, or the join will not generate multiple output rows from single input row.

        Issue Links

          Activity

          Hide
          apachespark Apache Spark added a comment -

          User 'davies' has created a pull request for this issue:
          https://github.com/apache/spark/pull/11740

          Show
          apachespark Apache Spark added a comment - User 'davies' has created a pull request for this issue: https://github.com/apache/spark/pull/11740
          Hide
          davies Davies Liu added a comment -

          Issue resolved by pull request 11740
          https://github.com/apache/spark/pull/11740

          Show
          davies Davies Liu added a comment - Issue resolved by pull request 11740 https://github.com/apache/spark/pull/11740

            People

            • Assignee:
              davies Davies Liu
              Reporter:
              davies Davies Liu
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development