Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28576

Fix the dead lock issue when enable new adaptive execution

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.4.3
    • None
    • SQL

    Description

      After enable AE(SPARK-23128), we found the dead lock issue in Q6 1TB TPC-DS. The root cause is that the subquery thread and the main thread is waiting for the same object.

      Attachments

        1. jstack.log
          193 kB
          Ke Jia
        2. physical plan.txt
          10 kB
          Ke Jia
        3. q6.sql
          0.6 kB
          Ke Jia

        Issue Links

          Activity

            People

              Unassigned Unassigned
              Jk_Self Ke Jia
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: