[SPARK-21363] Prevent column name duplication in temporary view

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.1.1
• Component/s: SQL
• Labels: bulk-closed
• Target Version/s: 3.0.0
• Assignee: Unassigned
• Reporter: Takeshi Yamamuro
• Created: 10/Jul/17 15:06
• Updated: 15/Jul/19 23:40
• Resolved: 21/May/19 04:13

Description

In SPARK-20460, we refactored some existing checks for column name duplication. The master currently allows name duplication for temporary views like an example below though, IMO we better prevent it along with permanent views (the master prevents the case for the permanent views).

scala> Seq((1, 1)).toDF("a", "a").createOrReplaceTempView("t")
scala> sql("SELECT * FROM t").show
+---+---+
|  a|  a|
+---+---+
|  1|  1|
+---+---+

Issue Links

• relates to: SPARK-28252 local/global temp view should not accept duplicate column names