Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20456

Add examples for functions collection for pyspark

    XMLWordPrintableJSON

    Details

    • Type: Documentation
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.3.0
    • Component/s: Documentation, PySpark
    • Labels:
      None
    • Target Version/s:

      Description

      Document sql.functions.py:

      1. Add examples for the common string functions (upper, lower, and reverse)
      2. Rename columns in datetime examples to be more informative (e.g. from 'd' to 'date')
      3. Add examples for unix_timestamp, from_unixtime, rand, randn, collect_list, collect_set, lit,
      4. Add note to all trigonometry functions that units are radians.
      5. Add links between functions, (e.g. add link to radians from toRadians)

        Attachments

          Activity

            People

            • Assignee:
              map222 Michael Patterson
              Reporter:
              map222 Michael Patterson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: