[IMPALA-5181] Make it possible to get Python package metadata from an HTML web page in pip_download.py

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 2.9.0
• Component/s: Infrastructure
• Epic Color: ghx-label-1
• Assignee: Taras Bobrovytsky
• Reporter: Taras Bobrovytsky
• Created: 07/Apr/17 01:15
• Updated: 08/Apr/17 01:54
• Resolved: 08/Apr/17 01:54

Description

Currently pip_download.py allows retrieving Python package metadata only from a JSON file, for example https://pypi.python.org/pypi/pyparsing/json. This is a problem because some PYPI mirrors might not implement this interface.

The data in the JSON file should also be accessible through a web interface - for example, https://pypi.python.org/simple/pyparsing/

pip_download.py should be able to parse the web page and extract the information we need.