Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1267

PySparkInterpreter doesn't work in spark 2.0

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.6.1, 0.7.0
    • Component/s: Interpreters
    • Labels:
      None

      Description

      py4j and pyspark.zip is not distributed to executors.

      Error from python worker:
        /usr/bin/python: No module named pyspark
      PYTHONPATH was:
        /Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/filecache/27/__spark_libs__3944184934921201174.zip/spark-core_2.11-2.0.0.jar
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjffdu Jeff Zhang
                Reporter:
                zjffdu Jeff Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: