[IMPALA-3762] download_requirements should run in buildall, but only if needed

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.7.0
• Component/s: Infrastructure
• Labels: asf asf-milestone-1
• Assignee: Tim Armstrong
• Reporter: Jim Apple
• Created: 20/Jun/16 20:03
• Updated: 23/Jun/16 16:11
• Resolved: 23/Jun/16 16:11

Description

The ASF tree does not build today because virtualenv isn't in the tree. Users need to run infra/python/deps/download_requirements, but this isn't documented (AFAIK) or run by default in buildall.sh

Also, if we need to upgrade the components download_requirements downloads, we have to get that message out, somehow.

I propose we use it to download requirements based on their version number and if those requirements are already available.