[SPARK-7133] Implement struct, array, and map field accessor using apply in Scala and __getitem__ in Python

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: SQL
• Target Version/s: 1.4.0
• Sprint: Spark 1.5 doc/QA sprint
• Assignee: Wenchen Fan
• Reporter: Reynold Xin
• Created: 24/Apr/15 20:02
• Updated: 11/May/15 23:02
• Resolved: 08/May/15 18:50

Description

Typing

df.col[1]

and

df.col['field']

is so much eaiser than

df.col.getField('field')
df.col.getItem(1)

This would require us to define (in Column) an apply function in Scala, and a _getitem_ function in Python.

Issue Links

• is related to: SPARK-7544 pyspark.sql.types.Row should implement __getitem__
• links to: [Github] Pull Request #5744 (cloud-fan)