[SPARK-44291] [CONNECT][SCALA] range query returns incorrect schema

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.1
• Fix Version/s: 3.5.0
• Component/s: Connect
• Assignee: Niranjan Jayakar
• Reporter: Niranjan Jayakar
• Created: 04/Jul/23 05:58
• Updated: 05/Jul/23 19:13
• Resolved: 05/Jul/23 19:13

Description

The following code on Spark Connect produces the following output

Code:

 

val df = spark.range(3)

df.show()
df.printSchema()

 

Output:

+---+
| id|
+---+
|  0|
|  1|
|  2|
+---+

root
 |-- value: long (nullable = true) 

The mismatch is that one shows the column as "id" while the other shows this as "value".