Description
Python modules added through SparkContext.addPyFile() are currently appended to sys.path; this is probably the opposite of the behavior that we want, since it causes system versions of modules to take precedence over versions explicitly added by users.
To fix this, we should change the sys.path manipulation code in context.py and worker.py to prepend files to sys.path.
Attachments
Issue Links
- links to