[IMPALA-9142] Failure in PlannerTest.testSpillableBufferSizing: SCAN HDFS columns missing.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Frontend
• Labels: broken-build
• Epic Color: ghx-label-14
• Assignee: Tim Armstrong
• Reporter: Anurag Mantripragada
• Created: 09/Nov/19 02:48
• Updated: 12/Nov/19 17:54
• Resolved: 12/Nov/19 17:54

Description

Not sure if the mt_dop planner changes has anything to do with this. Please feel free to reassign this.

It seems like the columns are missing for functional_parquet.alltypestiny table.

Happened here: https://master-02.jenkins.cloudera.com/job/impala-asf-master-exhaustive/866

Actual:
|--03:EXCHANGE [BROADCAST]
|  |  mem-estimate=251.92KB mem-reservation=0B thread-reservation=0
|  |  tuple-ids=1 row-size=80B cardinality=unavailable
|  |  in pipelines: 01(GETNEXT)
|  |
|  F01:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
|  Per-Host Resources: mem-estimate=16.00MB mem-reservation=88.00KB thread-reservation=2
|  01:SCAN HDFS [functional_parquet.alltypestiny, RANDOM]
|     HDFS partitions=4/4 files=4 size=11.92KB
|     stored statistics:
|       table: rows=unavailable size=unavailable
|       partitions: 0/4 rows=unavailable
|       columns: unavailable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Expected:
|--03:EXCHANGE [BROADCAST]
|  |  mem-estimate=251.92KB mem-reservation=0B thread-reservation=0
|  |  tuple-ids=1 row-size=80B cardinality=unavailable
|  |  in pipelines: 01(GETNEXT)
|  |
|  F01:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
|  Per-Host Resources: mem-estimate=16.00MB mem-reservation=88.00KB thread-reservation=2
|  01:SCAN HDFS [functional_parquet.alltypestiny, RANDOM]
|     HDFS partitions=4/4 files=4 size=11.67KB
|     stored statistics:
|       table: rows=unavailable size=unavailable
|       partitions: 0/4 rows=unavailable
|       columns missing stats: id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col 

Issue Links

• duplicates: IMPALA-9081 testMtDopValidationWithHDFSNumRowsEstDisabled toggles isTestEnv() changing table loading behaviour