[SPARK-38208] 'Column' object is not callable

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.2, 3.2.1
• Fix Version/s: 3.1.2
• Component/s: Deploy
• Assignee: Unassigned
• Reporter: Joyce Arruda Recacho
• Created: 14/Feb/22 15:23
• Updated: 14/Feb/22 17:21
• Resolved: 14/Feb/22 17:21

Description

Hi guys, I have such simple dataframe and am trying to create one new column.

That its schema:

 

>>>> df_operation_event_sellers.schema 

Out[69]: StructType(List(StructField(id,StringType,true),StructField(account_id,StringType,true),StructField(p_tenant_id,StringType,true),StructField(vendor_id,StringType,true),StructField(amount,DecimalType(38,18),true),StructField(operation_type,StringType,true),StructField(reference_id,StringType,true),StructField(date,TimestampType,true),StructField(carrier_id,StringType,true),StructField(account_number,StringType,true),StructField(data_source,StringType,true),StructField(entity,StringType,true),StructField(ingestion_date,DateType,true),StructField(event_type,StringType,false),StructField(amount_new,DecimalType(38,18),true),StructField(date_new,IntegerType,true),StructField(row_num,IntegerType,true)))

 

>>> command to create the new column

df_operation_event_sellers= df_operation_event_sellers.withColumn('flag_first_selling',when(col('row_num') == 1,'YES').instead('NO'))

ISSUE >>>>>>>>>>>> TypeError: 'Column' object is not callable

 

What is happing?

ps. I created other columns the same way successfully