Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9705

outdated Python 3 and IPython information

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Documentation
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.4.0, 1.4.1, 1.5.0
    • Fix Version/s: 1.5.0
    • Component/s: Documentation, PySpark
    • Labels:

      Description

      https://issues.apache.org/jira/browse/SPARK-4897 adds Python 3.4 support to 1.4.0 and above, but the official docs (1.4.1, but the same is for 1.4.0) says explicitly:
      "Spark 1.4.1 works with Python 2.6 or higher (but not Python 3)."

      Affected:
      https://spark.apache.org/docs/1.4.0/programming-guide.html
      https://spark.apache.org/docs/1.4.1/programming-guide.html

      There are some other Python-related things, which are outdated, e.g. this line:
      "For example, to launch the IPython Notebook with PyLab plot support:"
      (At least since IPython 3.0 PyLab/Matplotlib support happens inside a notebook; and the line "--pylab inline" is already removed.)

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              davies Davies Liu
              Reporter:
              pmigdal Piotr MigdaƂ
              Shepherd:
              Josh Rosen

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 0.25h
                0.25h
                Remaining:
                Remaining Estimate - 0.25h
                0.25h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Issue deployment