[IMPALA-4565] Incorrect results under ASAN with mt_dop > 0 and old aggs/joins

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.8.0
• Fix Version/s: Impala 2.8.0
• Component/s: Backend
• Labels: correctness multithreading
• Target Version: Impala 2.8.0
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 01/Dec/16 06:45
• Updated: 02/Dec/16 07:52
• Resolved: 02/Dec/16 07:52

Description

There are 7300 rows in alltypes but count returns varying numbers.

[tarmstrong-box.ca.cloudera.com:21000] > use functional_parquet; set mt_dop=1; select count(*) from alltypes; summary;
Query: use functional_parquet
MT_DOP set to 1
Query: select count(*) from alltypes
Query submitted at: 2016-11-30 22:31:17 (Coordinator: http://tarmstrong-box:25000)
Query progress can be monitored at: http://tarmstrong-box:25000/query_plan?query_id=3346df982e7ba933:b9cbaacf00000000
+----------+
| count(*) |
+----------+
| 900      |
+----------+
Fetched 1 row(s) in 0.13s
+--------------+--------+----------+----------+-------+------------+----------+---------------+-----------------------------+
| Operator     | #Hosts | Avg Time | Max Time | #Rows | Est. #Rows | Peak Mem | Est. Peak Mem | Detail                      |
+--------------+--------+----------+----------+-------+------------+----------+---------------+-----------------------------+
| 03:AGGREGATE | 1      | 762.35us | 762.35us | 1     | 1          | 8.04 MB  | -1 B          | FINALIZE                    |
| 02:EXCHANGE  | 1      | 56.20us  | 56.20us  | 3     | 1          | 0 B      | -1 B          | UNPARTITIONED               |
| 01:AGGREGATE | 3      | 541.97us | 571.22us | 3     | 1          | 8.02 MB  | 10.00 MB      |                             |
| 00:SCAN HDFS | 3      | 6.00ms   | 7.60ms   | 900   | 7.30K      | 16.00 KB | 0 B           | functional_parquet.alltypes |
+--------------+--------+----------+----------+-------+------------+----------+---------------+-----------------------------+