[IMPALA-7097] Print EC info in the query plan and profile

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 3.1.0
• Fix Version/s: Impala 4.0.0
• Component/s: Frontend
• Epic Color: ghx-label-3
• Assignee: Qifan Chen
• Reporter: Tianyi Wang
• Created: 30/May/18 23:39
• Updated: 30/Oct/20 19:35
• Resolved: 30/Oct/20 19:35

Description

Impala should print EC-related info in the query plan to help user understand the behavior and diagnose performance issues easier. The most trivial design would look like:

[localhost:21000] functional> explain select * from functional.alltypes;
Query: explain select * from functional.alltypes
+-------------------------------------------------------------+
| Explain String                                              |
+-------------------------------------------------------------+
| Max Per-Host Resource Reservation: Memory=32.00KB Threads=3 |
| Per-Host Resource Estimates: Memory=160.00MB                |
| Codegen disabled by planner                                 |
|                                                             |
| PLAN-ROOT SINK                                              |
| |                                                           |
| 01:EXCHANGE [UNPARTITIONED]                                 |
| |                                                           |
| 00:SCAN HDFS [functional.alltypes]                          |
|    partitions=24/24 files=25 size=498.41KB                  |
|    EC files=24 size=478.45KB                                |
+-------------------------------------------------------------+

In the query profile we should at least print "EC bytes scanned" in the scan node.

Issue Links

• is related to: IMPALA-6050 Query profiles should clearly indicate storage layer(s) used