[BIGTOP-3644] Improve dowload artifact resilency in Gradle/Maven/etc..

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Luca Toscano
• Created: 20/Feb/22 09:47
• Updated: 05/Mar/22 09:42

Description

There seem to be a lot of failures in building trunk packages in CI related to downloading artifacts. One of the issues seems to be using the Gradle download plugin (IIUC outside the realm of our NEXUS cache proxy) usually ending up in error messages like:

• What went wrong:
  Execution failed for task ':hbase-download'.
  > Could not download file

My understanding is that we are using the Gradle plugin de.undercouch.download, versio 3.2.0. From 4.0+, a nice retry functionality was added:

https://github.com/michel-kraemer/gradle-download-task/commit/c6d616a1184b935d16dd3be9f694d56ced1c01df

And afaics from https://github.com/michel-kraemer/gradle-download-task#migrating-from-version-3x-to-4x we should be compatible with a 4.x version.

Sub-Tasks

• Nexus local mirror functionality doesn't work in CI build: Resolved