Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31851 Redesign PySpark documentation
  3. SPARK-34190

Supplement the description for Python Package Management

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.1.1
    • Component/s: Documentation
    • Labels:
      None

      Description

      There is lack of explanation for "Using Virtualenv" chapter.

      It says "It packs the current virtual environment to an archive file, and It self-contains both Python interpreter and the dependencies", but it's not working if there is no Python installed on the node.

      Because the Python in the packed environment has a symbolic link that connects Python to the local one, so Python must exist in the same path on all nodes.

       

        Attachments

          Activity

            People

            • Assignee:
              itholic Haejoon Lee
              Reporter:
              itholic Haejoon Lee
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: