Apache Drill
  1. Apache Drill
  2. DRILL-938

Simplifed SF100 TPCH query returns incorrect results

    Details

      Description

      This simplified query is dropping records. Should return 150M, returns 146,485,463.

      select
       count(*) 
      from
        customer c,
        orders o
      where
        c.c_custkey = o.o_custkey
      

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        11d 4h 44m 1 Aman Sinha 21/Jun/14 02:30
        Patch Available Patch Available Resolved Resolved
        5d 23h 1 Jacques Nadeau 27/Jun/14 01:30
        Tony Stevenson made changes -
        Workflow no-reopen-closed, patch-avail, testing [ 12868314 ] Drill workflow [ 12934301 ]
        Jacques Nadeau made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Aman Sinha made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Aman Sinha made changes -
        Assignee Aman Sinha [ amansinha100 ] DrillCommitter [ drillcommitter ]
        Hide
        Aman Sinha added a comment -

        I was able to reproduce the wrong result on SF1 scale factor , max width set to 10. The issue was with resizing of the hash table. During resizing (which includes rehashing) the entries in the links vector were not set correctly if the hash chain spanned multiple batch holders. The attached patch has the fix for this. Note that I have tested it on SF1 scale factor only, not SF100.

        Show
        Aman Sinha added a comment - I was able to reproduce the wrong result on SF1 scale factor , max width set to 10. The issue was with resizing of the hash table. During resizing (which includes rehashing) the entries in the links vector were not set correctly if the hash chain spanned multiple batch holders. The attached patch has the fix for this. Note that I have tested it on SF1 scale factor only, not SF100.
        Aman Sinha made changes -
        Jacques Nadeau made changes -
        Assignee Jacques Nadeau [ jnadeau ] Aman Sinha [ amansinha100 ]
        Jacques Nadeau made changes -
        Field Original Value New Value
        Fix Version/s 1.0.0-BETA1 [ 12324963 ]
        Jacques Nadeau created issue -

          People

          • Assignee:
            DrillCommitter
            Reporter:
            Jacques Nadeau
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development