[IMPALA-8693] RPC failure between coordinator and executor leads to bogus "Cancelled" error

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Cannot Reproduce
• Affects Version/s: Impala 3.3.0
• Component/s: Distributed Exec
• Labels: observability
• Target Version: Impala 4.0.0
• Epic Color: ghx-label-5
• Assignee: Michael Ho
• Reporter: Tim Armstrong
• Created: 20/Jun/19 22:52
• Updated: 16/Jun/20 04:13
• Resolved: 16/Jun/20 04:13

Description

Impala returns bogus "Cancelled" error for some RPC failures. I saw an example caused by KUDU-2871. I've attached log lines relating to the query. The shell output looked like this:

Query submitted at: 2019-06-19 09:54:40 (Coordinator: https://quasar-epvzqp-4.vpc.cloudera.com:25000)
Query progress can be monitored at: https://quasar-epvzqp-4.vpc.cloudera.com:25000/query_plan?query_id=2b4de6f8564f0cef:9ff7b87500000000
ERROR: Cancelled