[SPARK-41832] DataFrame.unionByName output is wrong

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Connect
• Assignee: Sandeep Singh
• Reporter: Sandeep Singh
• Created: 02/Jan/23 17:46
• Updated: 14/Jan/23 09:16
• Resolved: 14/Jan/23 09:16

Description

File "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py", line 584, in pyspark.sql.connect.dataframe.DataFrame.unionByName
Failed example:
    df1.unionByName(df2).show()
Expected:
    +----+----+----+
    |col0|col1|col2|
    +----+----+----+
    |   1|   2|   3|
    |   6|   4|   5|
    +----+----+----+
Got:
    +----+----+----+
    |col0|col1|col2|
    +----+----+----+
    |   1|   2|   3|
    |   4|   5|   6|
    +----+----+----+
    <BLANKLINE>

Issue Links

• links to: [Github] Pull Request #39451 (techaddict)
• links to: [Github] Pull Request #39451 (techaddict)