Details

      Description

      Datasources: TPCH (10MB), three-way split parquet files
      git.commit.id.abbrev=92408f1
      git.commit.id=92408f193043fa3049d114930a97ecf2332e08c0

      A large amount of discrepant data for the following query:

      2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query:
      /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q : alter session set `planner.enable_mergejoin` = false
      2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query:
      /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q :
      select o.O_TOTALPRICE
      from customer c, orders o
      where c.C_CUSTKEY = o.O_CUSTKEY

        Activity

        Hide
        Zhiyong Liu added a comment -

        Re-tested it using the test framework without limiting or using order by, and test passed verification:

        git.commit.id.abbrev=fb2091a
        git.commit.id=fb2091ad74bc677b309e5d32d375729dd5bf45bc

        Show
        Zhiyong Liu added a comment - Re-tested it using the test framework without limiting or using order by, and test passed verification: git.commit.id.abbrev=fb2091a git.commit.id=fb2091ad74bc677b309e5d32d375729dd5bf45bc
        Hide
        Aman Sinha added a comment -

        I don't see a bug. I ran the following 2 queries on the latest master branch and got the same results as Postgres:
        select o.o_totalprice from customer c, orders o where c.c_custkey = o.o_custkey order by o.o_totalprice limit 20;
        select o.o_totalprice from customer c, orders o where c.c_custkey = o.o_custkey order by o.o_totalprice desc limit 20;

        Note that I added an Order-By and limit to the original query because otherwise it is difficult to verify the results. Please run the above queries to verify.

        Show
        Aman Sinha added a comment - I don't see a bug. I ran the following 2 queries on the latest master branch and got the same results as Postgres: select o.o_totalprice from customer c, orders o where c.c_custkey = o.o_custkey order by o.o_totalprice limit 20; select o.o_totalprice from customer c, orders o where c.c_custkey = o.o_custkey order by o.o_totalprice desc limit 20; Note that I added an Order-By and limit to the original query because otherwise it is difficult to verify the results. Please run the above queries to verify.
        Hide
        Zhiyong Liu added a comment -

        2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query:
        /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q : alter sessi
        on set `planner.enable_mergejoin` = false
        2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query:
        /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q :
        select o.O_TOTALPRICE
        from customer c, orders o
        where c.C_CUSTKEY = o.O_CUSTKEY
        2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query:
        /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q :
        alter session set `planner.enable_mergejoin` = true
        2014-05-23 14:44:27 INFO DrillTestBase:212 - Query submit end time: 2014/05/23 14:44:27.0027
        2014-05-23 14:44:27 INFO DrillTestBase:213 - The execution time for the query: 0 seconds.
        2014-05-23 14:44:27 INFO TestVerifier:203 - These rows are not expected:
        2014-05-23 14:44:27 INFO TestVerifier:206 - 23802.3 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 205476.4 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 73691.7 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 93291.1 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 121227.2 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 241674.7 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 93645.3 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 210146.6 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 260234.3 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:206 - 79836.5 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:213 - Total number of unexpected rows: 1424
        2014-05-23 14:44:27 INFO TestVerifier:217 - These rows are expected but are not in result set:
        2014-05-23 14:44:27 INFO TestVerifier:220 - 233753.80 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 257840.10 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 160291.80 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 245196.00 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 65151.40 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 219752.50 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 172660.10 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 188306.60 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 23107.80 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:220 - 132412.30 : 1 time(s).
        2014-05-23 14:44:27 INFO TestVerifier:227 - Total number of expected but missing: 1424

        Show
        Zhiyong Liu added a comment - 2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query: /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q : alter sessi on set `planner.enable_mergejoin` = false 2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query: /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q : select o.O_TOTALPRICE from customer c, orders o where c.C_CUSTKEY = o.O_CUSTKEY 2014-05-23 14:44:27 INFO DrillTestBase:275 - Submitting query: /root/open-source-drill-test/testing/framework/resources/tpch-smoke/testcases/join10-hash.q : alter session set `planner.enable_mergejoin` = true 2014-05-23 14:44:27 INFO DrillTestBase:212 - Query submit end time: 2014/05/23 14:44:27.0027 2014-05-23 14:44:27 INFO DrillTestBase:213 - The execution time for the query: 0 seconds. 2014-05-23 14:44:27 INFO TestVerifier:203 - These rows are not expected: 2014-05-23 14:44:27 INFO TestVerifier:206 - 23802.3 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 205476.4 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 73691.7 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 93291.1 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 121227.2 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 241674.7 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 93645.3 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 210146.6 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 260234.3 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:206 - 79836.5 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:213 - Total number of unexpected rows: 1424 2014-05-23 14:44:27 INFO TestVerifier:217 - These rows are expected but are not in result set: 2014-05-23 14:44:27 INFO TestVerifier:220 - 233753.80 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 257840.10 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 160291.80 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 245196.00 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 65151.40 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 219752.50 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 172660.10 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 188306.60 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 23107.80 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:220 - 132412.30 : 1 time(s). 2014-05-23 14:44:27 INFO TestVerifier:227 - Total number of expected but missing: 1424

          People

          • Assignee:
            Zhiyong Liu
            Reporter:
            Zhiyong Liu
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development