[IMPALA-11341] Print error log files when data-loading fails

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.2.0
• Component/s: Infrastructure
• Epic Color: ghx-label-10
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 08/Jun/22 07:47
• Updated: 02/Jul/22 03:27
• Resolved: 21/Jun/22 07:31

Description

When the data-loading phase fails, we see console ouputs like

05:04:02 Beginning execution of hive SQL: /home/ubuntu/Impala/logs/data_loading/sql/functional/load-functional-query-exhaustive-hive-generated-rc-def-block.sql
05:05:34 Finished execution of hive SQL: /home/ubuntu/Impala/logs/data_loading/sql/functional/load-functional-query-exhaustive-hive-generated-seq-bzip-record.sql
05:05:34 Error executing hive SQL: /home/ubuntu/Impala/logs/data_loading/sql/functional/load-functional-query-exhaustive-hive-generated-text-def-block.sql See: /home/ubuntu/Impala/logs/data_loading/sql/functional/load-functional-query-exhaustive-hive-generated-text-def-block.sql.log
05:05:34 Beginning execution of hive SQL: /home/ubuntu/Impala/logs/data_loading/sql/functional/load-functional-query-exhaustive-hive-generated-seq-bzip-block.sql
05:05:34 Beginning execution of hive SQL: /home/ubuntu/Impala/logs/data_loading/sql/functional/load-functional-query-exhaustive-hive-generated-seq-gzip-record.sql
Background task Loading functional-query data (pid 14732) failed.
ERROR in /home/ubuntu/Impala/testdata/bin/create-load-data.sh at line 85: fi
Generated: /home/ubuntu/Impala/logs/extra_junit_xml_logs/generate_junitxml.buildall.create-load-data.20220607_05_05_34.xml
 

We still need to download the Jenkins log file and extract the tarball to get load-functional-query-exhaustive-hive-generated-text-def-block.sql.log. It'd be helpful if we can print its last 50 lines as well.