Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-37647

Expose percentile function in Scala/Python APIs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.2.0
    • None
    • PySpark, SQL
    • None

    Description

      SQL offers a percentile function (exact, not approximate) that is not available directly in the Scala or Python DataFrame APIs.

      While it is possible to invoke SQL functions from Scala or Python via expr(), I think most users expect function parity across Scala, Python, and SQL. 

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-26589 proper `median` method for spark dataframe

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              nchammas Nicholas Chammas
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: