[IMPALA-12697] Native toolchain upload to S3 silently failed

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.4.0
• Component/s: Infrastructure
• Epic Color: ghx-label-13
• Assignee: Laszlo Gaal
• Reporter: Michael Smith
• Created: 09/Jan/24 20:03
• Updated: 21/Apr/24 14:52
• Resolved: 28/Mar/24 20:55

Description

A native-toolchain build silently failed to upload to S3

21:03:52 impala-toolchain-redhat8: Uploading /mnt/build/orc-1.7.9-p10-gcc-10.4.0.tar.gz to s3://native-toolchain/build/11-8dbe785e9e/orc/1.7.9-p10-gcc-10.4.0/orc-1.7.9-p10-gcc-10.4.0-ec2-package-centos-8-aarch64.tar.gz
21:03:52 impala-toolchain-redhat8: /mnt/functions.sh: line 383: 1119230 Segmentation fault      (core dumped) aws s3 cp --only-show-errors "${PACKAGE_FINAL_TGZ}" "${PACKAGE_S3_DESTINATION}"
21:03:52 impala-toolchain-redhat8: Uploading to mirror:
21:03:52 impala-toolchain-redhat8: Uploading /mnt/build/orc-1.7.9-p10-gcc-10.4.0.tar.gz to s3://native-toolchain-us-west-2/build/11-8dbe785e9e/orc/1.7.9-p10-gcc-10.4.0/orc-1.7.9-p10-gcc-10.4.0-ec2-package-centos-8-aarch64.tar.gz
21:03:52 impala-toolchain-redhat8: Cleaning /mnt/source/orc ...

It should have failed the build.

Issue Links

• causes: IMPALA-13025 Use AWSCLI v2 for bucket uploads during toolchain builds