[IMPALA-9815] Intermittent failure downloading org.apache.hive:hive-exec:jar:3.1.3000.xxxx during build

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0, Impala 3.4.1
• Component/s: Frontend
• Labels: broken-build flaky
• Epic Color: ghx-label-12
• Assignee: Tim Armstrong
• Reporter: Laszlo Gaal
• Created: 01/Jun/20 22:52
• Updated: 05/Feb/21 13:27
• Resolved: 14/Oct/20 16:36

Description

This is an intermittent failure; sometimes org.apache.hive:hive-exec:jar:3.1.3000 fails to be downloaded, breaking the build. One telltale sign is a build failure happening early, at about 5 minutes into the build. The build error signature is:

05:36:55 [ERROR] Failed to execute goal on project impala-minimal-hive-exec: Could not resolve dependencies for project org.apache.impala:impala-minimal-hive-exec:jar:0.1-SNAPSHOT: Failed to collect dependencies for [org.apache.hive:hive-exec:jar:3.1.3000.7.2.1.0-112 (compile)]: Failed to read artifact descriptor for org.apache.hive:hive-exec:jar:3.1.3000.7.2.1.0-112: Could not transfer artifact org.apache.hive:hive-exec:pom:3.1.3000.7.2.1.0-112 from/to impala.cdh.repo (https://native-toolchain.s3.amazonaws.com/build/cdh_components/1814051/maven): Access denied to: https://native-toolchain.s3.amazonaws.com/build/cdh_components/1814051/maven/org/apache/hive/hive-exec/3.1.3000.7.2.1.0-112/hive-exec-3.1.3000.7.2.1.0-112.pom, ReasonPhrase:Forbidden. -> [Help 1]
05:36:55 [ERROR] 
05:36:55 [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
05:36:55 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
05:36:55 [ERROR] 
05:36:55 [ERROR] For more information about the errors and possible solutions, please read the following articles:
05:36:55 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
05:36:55 mvn -U -s /data/jenkins/workspace/impala-cdpd-master-core/repos/Impala-auxiliary-tests/jenkins/m2-settings.xml -U -B install -DskipTests exited with code 0
05:36:55 make[2]: *** [shaded-deps/CMakeFiles/shaded-deps] Error 1
05:36:55 make[1]: *** [shaded-deps/CMakeFiles/shaded-deps.dir/all] Error 2
05:36:55 make[1]: *** Waiting for unfinished jobs....

Issue Links

• relates to: IMPALA-8621 Flaky build on impala.jenkins.io - mvn downloading kerby