[SPARK-27087] Inability to access to column alias in pyspark

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 2.4.0
• Component/s: PySpark
• Assignee: Unassigned
• Reporter: Vincent
• Created: 07/Mar/19 13:31
• Updated: 12/Dec/22 18:10
• Resolved: 08/Mar/19 09:57

Description

In pyspark I have the following:

import pyspark.sql.functions as F
cc = F.lit(1).alias("A")

print(cc)
print(cc._jc.toString())

I get :

Column<b'1 AS `A`'>
1 AS `A`

Is there any way for me to just print "A" from cc ? it seems I'm unable to extract the alias programatically from the column object.

Also I think that in spark-sql in scala, if I print "cc" it would just print "A" instead, so this seem like a bug or a missing feature to me