[SPARK-35790] Spark Package Python Import does not work for namespace packages

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Not A Problem
• Affects Version/s: 3.0.0, 3.1.2
• Component/s: Build, PySpark, Spark Submit
• Assignee: Unassigned
• Reporter: Mark Hamilton
• Created: 16/Jun/21 17:31
• Updated: 12/Dec/22 18:11
• Resolved: 22/Jun/21 00:15

Description

If one includes python files within several jars that comprise a python "namespace package"
https://www.python.org/dev/peps/pep-0420/

Then only one of packages is imported