Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6453

TPC-DS query 72 has regressed

    XMLWordPrintableJSON

Details

    Description

      TPC-DS query 72 seems to have regressed, query profile for the case where it Canceled after 2 hours on Drill 1.14.0 is attached here.

      On, Drill 1.14.0-SNAPSHOT 
      commit : 931b43e (TPC-DS query 72 executed successfully on this commit, took around 55 seconds to execute)
      SF1 parquet data on 4 nodes; 
      planner.memory.max_query_memory_per_node = 10737418240. 
      drill.exec.hashagg.fallback.enabled = true
      
      TPC-DS query 72 executed successfully & took 47 seconds to complete execution.
      
      TPC-DS data in the below run has date values stored as DATE datatype and not VARCHAR type
      
      On, Drill 1.14.0-SNAPSHOT
      commit : 82e1a12
      SF1 parquet data on 4 nodes; 
      planner.memory.max_query_memory_per_node = 10737418240. 
      drill.exec.hashagg.fallback.enabled = true
      and
      alter system set `exec.hashjoin.num_partitions` = 1;
      
      TPC-DS query 72 executed for 2 hrs and 11 mins and did not complete, I had to Cancel it by stopping the Foreman drillbit.
      As a result several minor fragments are reported to be in CANCELLATION_REQUESTED state on UI.
      

      Attachments

        1. 24f75b18-014a-fb58-21d2-baeab5c3352c.sys.drill
          737 kB
          Khurram Faraaz
        2. jstack_29173_June_10_2018_b.txt
          279 kB
          Khurram Faraaz
        3. jstack_29173_June_10_2018_b.txt
          279 kB
          Khurram Faraaz
        4. jstack_29173_June_10_2018_c.txt
          279 kB
          Khurram Faraaz
        5. jstack_29173_June_10_2018_c.txt
          279 kB
          Khurram Faraaz
        6. jstack_29173_June_10_2018_d.txt
          279 kB
          Khurram Faraaz
        7. jstack_29173_June_10_2018_d.txt
          279 kB
          Khurram Faraaz
        8. jstack_29173_June_10_2018_e.txt
          75 kB
          Khurram Faraaz
        9. jstack_29173_June_10_2018_e.txt
          75 kB
          Khurram Faraaz
        10. jstack_29173_June_10_2018.txt
          279 kB
          Khurram Faraaz
        11. jstack_29173_June_10_2018.txt
          279 kB
          Khurram Faraaz

        Issue Links

          Activity

            People

              timothyfarkas Timothy Farkas
              khfaraaz Khurram Faraaz
              Boaz Ben-Zvi Boaz Ben-Zvi
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: