Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
Impala 3.2.0
Description
The recent commit to native-toolchain that enabled the publishing of binary artifacts from Docker-based toolchain builds (https://github.com/cloudera/native-toolchain/commit/eeccbcab224fca5c25a7b78898444037b94d88b7) changed the logic that gates the publishing calls.
Internal builds on Jenkins (using the same logic as before the change) now don't even attempt publishing even if parameterized to do so. Excerpt from the build log:
02:19:44.605 install -d /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:19:44.608 install -m 644 -p libcctz.a /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:19:44.860 install -d /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:19:44.863 install -m 644 -p libcctz.so.2.2 /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:19:44.880 make: Leaving directory `/data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/source/cctz/cctz-2.2/build' 02:19:45.399 Cleaning /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/source/cctz ... 02:19:45.400 Entering directory /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/source/cctz 02:19:45.457 Removing cctz-2.2.tar.gz 02:19:45.457 Removing cctz-2.2/ 02:19:45.459 Returning to directory /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain 02:19:45.459 # Build Complete cctz-2.2 02:19:45.459 ####################################################################### 02:19:45.549 + popd 02:19:45.549 /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem 02:19:45.579 Archiving artifacts 02:19:45.781 [description-setter] Description set: *******************redacted****************** 02:19:46.010 [WS-CLEANUP] Deleting project workspace... 02:19:46.010 [WS-CLEANUP] Deferred wipeout is used... 02:19:46.057 [WS-CLEANUP] done 02:19:46.057 Email was triggered for: Success 02:19:46.057 Sending email for trigger: Success 02:19:46.523 Sending email to: laszlo.gaal@cloudera.com 02:19:46.551 Finished: SUCCESS
The happy case with the missing steps (copied from another job that published the bits successfully):
02:26:22.083 install -d /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:26:22.085 install -m 644 -p libcctz.a /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:26:22.338 install -d /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:26:22.340 install -m 644 -p libcctz.so.2.2 /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2/lib 02:26:22.358 make: Leaving directory `/data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/source/cctz/cctz-2.2/build' 02:26:24.297 [INFO] Scanning for projects... 02:26:24.545 [INFO] 02:26:24.545 [INFO] ------------------------------------------------------------------------ 02:26:24.545 [INFO] Building Maven Stub Project (No POM) 1 02:26:24.546 [INFO] ------------------------------------------------------------------------ 02:26:24.552 [INFO] 02:26:24.552 [INFO] --- maven-deploy-plugin:2.7:deploy-file (default-cli) @ standalone-pom --- 02:26:25.079 Uploading: http://maven.****redacted****/toolchain/cctz/2.2-gcc-4.9.2-253-1ffcf70e3f/cctz-2.2-gcc-4.9.2-253-1ffcf70e3f-ec2-package-centos-5.tar.gz 02:26:25.400 Uploaded: http://maven.****redacted****/toolchain/cctz/2.2-gcc-4.9.2-253-1ffcf70e3f/cctz-2.2-gcc-4.9.2-253-1ffcf70e3f-ec2-package-centos-5.tar.gz (2681 KB at 8325.9 KB/sec) 02:26:25.401 Uploading: http://maven.****redacted****/toolchain/cctz/2.2-gcc-4.9.2-253-1ffcf70e3f/cctz-2.2-gcc-4.9.2-253-1ffcf70e3f.pom 02:26:25.421 Uploaded: http://maven.****redacted****/toolchain/cctz/2.2-gcc-4.9.2-253-1ffcf70e3f/cctz-2.2-gcc-4.9.2-253-1ffcf70e3f.pom (454 B at 21.1 KB/sec) 02:26:25.462 Downloading: http://maven.****redacted****/toolchain/cctz/maven-metadata.xml 02:26:25.462 [WARNING] Checksum validation failed, expected 760fe8b0820efb0518f69c6c3acc208ebc072663 but is 66cdea48553fd311f97552bd5e4e08c5330e468a for http://maven.****redacted****/toolchain/cctz/maven-metadata.xml 02:26:25.476 Downloaded: http://maven.****redacted****/toolchain/cctz/maven-metadata.xml (4 KB at 65.2 KB/sec) 02:26:25.492 Uploading: http://maven.****redacted****/toolchain/cctz/maven-metadata.xml 02:26:25.515 Uploaded: http://maven.****redacted****/toolchain/cctz/maven-metadata.xml (4 KB at 128.3 KB/sec) 02:26:25.516 [INFO] ------------------------------------------------------------------------ 02:26:25.516 [INFO] BUILD SUCCESS 02:26:25.517 [INFO] ------------------------------------------------------------------------ 02:26:25.518 [INFO] Total time: 1.249s 02:26:25.519 [INFO] Finished at: Sun Feb 24 17:27:53 PST 2019 02:26:25.652 [INFO] Final Memory: 15M/453M 02:26:25.652 [INFO] ------------------------------------------------------------------------ 02:26:25.673 Uploading /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/build/cctz-2.2-gcc-4.9.2.tar.gz to s3://native-toolchain/build/253-1ffcf70e3f/cctz/2.2-gcc-4.9.2/cctz-2.2-gcc-4.9.2-ec2-package-centos-5.tar.gz 02:26:26.487 Cleaning /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/source/cctz ... 02:26:26.488 Entering directory /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain/source/cctz 02:26:26.513 Removing cctz-2.2.tar.gz 02:26:26.514 Removing cctz-2.2/ 02:26:26.554 Returning to directory /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem/toolchain 02:26:26.554 # Build Complete cctz-2.2 02:26:26.554 ####################################################################### 02:26:26.602 + popd 02:26:26.602 /data/jenkins/workspace/impala-toolchain-package-build/label/impala-toolchnbld-cent58-ec2-c3-4xl-ondem 02:26:27.660 Archiving artifacts 02:26:28.316 [description-setter] Description set: ***************redacted***************** 02:26:29.285 [WS-CLEANUP] Deleting project workspace... 02:26:29.286 [WS-CLEANUP] Deferred wipeout is used... 02:26:29.294 [WS-CLEANUP] done 02:26:29.294 Email was triggered for: Success 02:26:29.294 Sending email for trigger: Success 02:26:29.707 Sending email to: laszlo.gaal@cloudera.com 02:26:29.736 Finished: SUCCESS