Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-1267

PySparkInterpreter doesn't work in spark 2.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.6.1, 0.7.0
    • Interpreters
    • None

    Description

      py4j and pyspark.zip is not distributed to executors.

      Error from python worker:
        /usr/bin/python: No module named pyspark
      PYTHONPATH was:
        /Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/filecache/27/__spark_libs__3944184934921201174.zip/spark-core_2.11-2.0.0.jar
      

      Attachments

        Issue Links

          Activity

            People

              zjffdu Jeff Zhang
              zjffdu Jeff Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: