Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6978

TPCH Q11 in testdata is not SF-aware

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.8.0
    • Fix Version/s: None
    • Component/s: Infrastructure
    • Labels:
      None

      Description

      http://www.tpc.org/tpc_documents_current_versions/pdf/tpc-h_v2.17.3.pdf p47 mentions Q11 is:

      select
        *
      from (
        select
          ps_partkey,
          sum(ps_supplycost * ps_availqty) as value
        from
          partsupp,
          supplier,
          nation
        where
          ps_suppkey = s_suppkey
          and s_nationkey = n_nationkey
          and n_name = 'GERMANY'
        group by
          ps_partkey
      ) as inner_query
      where
        value > (
          select
            sum(ps_supplycost * ps_availqty) * 0.0001 / SF
          from
            partsupp,
            supplier,
            nation
          where
            ps_suppkey = s_suppkey
            and s_nationkey = n_nationkey
            and n_name = 'GERMANY'
        )
      order by
        value desc
      

      testdata/workloads/tpch/queries/tpch-q11.test has this hardcoded to imply SF==1, which is fine for our minicluster, but not fine for tests that use code upstream and run in downstream environments on large SFs, like the stress test. On TPCH 10,000 for example this query produces no results. If you apply the correct formula with SF, though, this does produce results.

      Possible solutions: dynamically write the query based on SF, or keep a few queries at well-known scale factors.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mikeb Michael Brown
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: