Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23609

Test EnsureRequirements's test cases to eliminate ShuffleExchange while is not expected

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • SQL, Tests
    • None

    Description

      Currently, In testing EnsureRequirements's test cases to eliminate ShuffleExchange, The test code is not in conformity with the purpose of the test.These test cases are as follows:
      1、test("EnsureRequirements eliminates Exchange if child has same partitioning")
         The checking condition is that there is no ShuffleExchange in the physical plan. = = 2 It's not accurate here.
      2、test("EnsureRequirements does not eliminate Exchange with different partitioning")
         The purpose of the test is to not eliminate ShuffleExchange, but its test code is the same as test("EnsureRequirements eliminates Exchange if child has same partitioning")

      Attachments

        Activity

          People

            Unassigned Unassigned
            heary-cao caoxuewen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: