[SPARK-22375] Test script can fail if eggs are installed by setup.py during test process

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Tests

Environment

OSX 10.12.6

• External issue URL: https://github.com/pypa/setuptools/issues/391
• Assignee: Unassigned
• Reporter: Joel Croteau
• Created: 28/Oct/17 02:20
• Updated: 12/Dec/22 18:10
• Resolved: 29/Oct/17 08:10

Description

Running ./dev/run-tests may install missing Python packages as part of it's setup process. setup.py can cache these in python/.eggs, and since the lint-python script checks any file with the .py extension anywhere in the Spark project, it will check files in .eggs and will fail if any of these do not meet style criteria, even though these are not part of the project lint-spark should exclude python/.eggs from its search directories.

Issue Links

• links to: [Github] Pull Request #19597 (xynny)