Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: PySpark
    • Labels:
      None
    • Target Version/s:

      Description

      PyPy is much faster than CPython (about 5x), run PySpark in PyPy will also be useful for pure Python heavy computation applications.

        Issue Links

          Activity

          Hide
          apachespark Apache Spark added a comment -

          User 'davies' has created a pull request for this issue:
          https://github.com/apache/spark/pull/2144

          Show
          apachespark Apache Spark added a comment - User 'davies' has created a pull request for this issue: https://github.com/apache/spark/pull/2144
          Hide
          nchammas Nicholas Chammas added a comment -

          This is super cool. If PyPy grows to support Numpy, this could become useful to a lot more PySpark users, too!

          Show
          nchammas Nicholas Chammas added a comment - This is super cool. If PyPy grows to support Numpy , this could become useful to a lot more PySpark users, too!
          Hide
          joshrosen Josh Rosen added a comment -

          Issue resolved by pull request 2144
          https://github.com/apache/spark/pull/2144

          Show
          joshrosen Josh Rosen added a comment - Issue resolved by pull request 2144 https://github.com/apache/spark/pull/2144

            People

            • Assignee:
              davies Davies Liu
              Reporter:
              davies Davies Liu
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development