[SPARK-34190] Supplement the description for Python Package Management

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.1
• Component/s: Documentation
• Assignee: Haejoon Lee
• Reporter: Haejoon Lee
• Created: 21/Jan/21 09:10
• Updated: 12/Dec/22 18:10
• Resolved: 21/Jan/21 13:16

Description

There is lack of explanation for "Using Virtualenv" chapter.

It says "It packs the current virtual environment to an archive file, and It self-contains both Python interpreter and the dependencies", but it's not working if there is no Python installed on the node.

Because the Python in the packed environment has a symbolic link that connects Python to the local one, so Python must exist in the same path on all nodes.

 

Issue Links

• links to: [Github] Pull Request #31280 (itholic)