Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-32469

ApplyColumnarRulesAndInsertTransitions should be idempotent

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • SQL
    • None

    Description

      It's good hygiene to keep rules idempotent, even if we know the rule is going to be run only once. This is for future-proof.

      ApplyColumnarRulesAndInsertTransitions can add columnar-to-row and row-to-columnar operators repeatedly, we should fix it.

      Attachments

        Activity

          People

            cloud_fan Wenchen Fan
            cloud_fan Wenchen Fan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: