[IMPALA-5001] Allow bootstrap_toolchain.py to update dependencies if toolchain version changes

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: Impala 2.9.0
• Fix Version/s: Not Applicable
• Component/s: Infrastructure
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Henry Robinson
• Created: 27/Feb/17 21:01
• Updated: 24/Dec/20 01:08
• Resolved: 24/Dec/20 01:08

Description

Currently, if you update a dependency without changing its version, and run bin/bootstrap_toolchain.py, it won't download the new dependency.

This is a problem for situations like IMPALA-4983 where we want to change the build flags but don't have a new version number.

My suggestion is to use the toolchain build ID as a 'version' parameter, and write that to disk. If the toolchain ID changes, bootstrap_toolchain.py should detect that case and redownload all dependencies. Although it's suboptimal to download all dependencies, it's better than not downloading enough of them.