Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9576 DataFrame API improvement umbrella ticket (in Spark 2.x)
  3. SPARK-7544

pyspark.sql.types.Row should implement __getitem__

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.6.0
    • PySpark, SQL
    • None

    Description

      Following from the related discussions in SPARK-7505 and SPARK-7133, the Row type should implement __getitem__ so that people can do this

      row['field']

      instead of this:

      row.field

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-10056 PySpark Row - Support for row["columnName"] syntax

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue SPARK-7133 Implement struct, array, and map field accessor using apply in Scala and __getitem__ in Python

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-7505 Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Pull request #8333 [Github] Pull Request #8333 (yanboliang)

          Activity

            People

              yanboliang Yanbo Liang
              nchammas Nicholas Chammas
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: