[IMPALA-7348] PlannerTest.testKuduSelectivity failing due to missing Cardinality information - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: Impala 3.1.0
Component/s: Infrastructure
Labels:
- broken-build

Description

PlannerTest.testKuduSelectivity failed in the recent run. It is an assertion failure to unavailable cardinality information.

Assertion failure as follows

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id = '8600000US00601'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section PLAN of query:
select * from functional_kudu.zipcode_incomes where id != '1' and zip = '2'

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id != '1' and zip = '2'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section PLAN of query:
select * from functional_kudu.zipcode_incomes where id > '1' and zip > '2'

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: zip > '2', id > '1'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3317

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id > '1' and zip > '2'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3317

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: zip > '2', id > '1'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3317

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section PLAN of query:
select * from functional_kudu.zipcode_incomes where id = '1' or id = '2' or zip = '3'

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id = '1' or id = '2' or zip = '3'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
Stacktrace
java.lang.AssertionError:
Section PLAN of query:
select * from functional_kudu.zipcode_incomes where id = '8600000US00601'

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id = '8600000US00601'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id = '8600000US00601'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section PLAN of query:
select * from functional_kudu.zipcode_incomes where id != '1' and zip = '2'

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id != '1' and zip = '2'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=1

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id != '1'
     kudu predicates: zip = '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section PLAN of query:
select * from functional_kudu.zipcode_incomes where id > '1' and zip > '2'

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: zip > '2', id > '1'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3317

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id > '1' and zip > '2'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3317

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: zip > '2', id > '1'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3317

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     kudu predicates: id > '1', zip > '2'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section PLAN of query:
select * from functional_kudu.zipcode_incomes where id = '1' or id = '2' or zip = '3'

Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3

Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Section DISTRIBUTEDPLAN of query:
select * from functional_kudu.zipcode_incomes where id = '1' or id = '2' or zip = '3'

Actual does not match expected result:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

Expected:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=124B cardinality=3

Verbose plan:
F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  PLAN-ROOT SINK
  |  mem-estimate=0B mem-reservation=0B
  |
  01:EXCHANGE [UNPARTITIONED]
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
Per-Host Resources: mem-estimate=0B mem-reservation=0B
  DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=01, UNPARTITIONED]
  |  mem-estimate=0B mem-reservation=0B
  00:SCAN KUDU [functional_kudu.zipcode_incomes]
     predicates: id IN ('1', '2') OR zip = '3'
     mem-estimate=0B mem-reservation=0B
     tuple-ids=0 row-size=68B cardinality=unavailable

at org.junit.Assert.fail(Assert.java:88)
at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:841)
at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:779)
at org.apache.impala.planner.PlannerTest.testKuduSelectivity(PlannerTest.java:355)

Attachments

Activity

People

Assignee:: Thomas Tauber-Marshall

Reporter:: nithya

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 25/Jul/18 17:34

Updated:: 18/Sep/18 20:07

Resolved:: 18/Sep/18 20:07