[SPARK-32377] CaseInsensitiveMap should be deterministic for addition

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.3, 2.2.3, 2.3.4, 2.4.6, 3.0.0
• Fix Version/s: 2.4.7, 3.0.1, 3.1.0
• Component/s: SQL
• Assignee: Dongjoon Hyun
• Reporter: Girish A Pandit
• Created: 21/Jul/20 00:39
• Updated: 21/Jul/20 22:58
• Resolved: 21/Jul/20 06:03

Description

import org.apache.spark.sql.catalyst.util.CaseInsensitiveMap
var m = CaseInsensitiveMap(Map.empty[String, String])
Seq(("paTh", "1"), ("PATH", "2"), ("Path", "3"), ("patH", "4"), ("path", "5")).foreach { kv =>
  m = (m + kv).asInstanceOf[CaseInsensitiveMap[String]]
  println(m.get("path"))
}

Some(1)
Some(2)
Some(3)
Some(4)
Some(1)

Issue Links

• links to: [Github] Pull Request #29172 (dongjoon-hyun)
• links to: [Github] Pull Request #29175 (dongjoon-hyun)
• links to: [Github] Pull Request #29175 (dongjoon-hyun)