Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13404

Create the variables for input when it's used

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • SQL
    • None

    Description

      Right now, we create the variables in the first operator (usually InputAdapter), they could be wasted if most of rows after filtered out immediately.

      We should defer that until they are used by following operators.

      Attachments

        Activity

          People

            davies Davies Liu
            davies Davies Liu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: