Description
The pyspark shell allows custom start scripts to run using the PYTHONSTARTUP environment variable. The value specified there will get run at the end of the shell startup by a call to execfile. However, execfile is deprecated in python3 and thus this does not work for python3 users. The simply fix is to follow the 2to3 recommendation and read, compile and exec the file manually as per this PR: https://github.com/apache/spark/pull/10255
Attachments
Issue Links
- links to
Activity
Transition | Time In Source Status | Execution Times |
---|
Apache Spark
made transition
-
|
33d 19h 23m | 1 |
Josh Rosen
made transition
-
|
4h 24m | 1 |