[SPARK-47563] Map normalization upon creation

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Stevo Mitric
• Reporter: Stevo Mitric
• Created: 26/Mar/24 10:14
• Updated: 27/Mar/24 10:56
• Resolved: 27/Mar/24 10:56

Description

Add handling of map normalization upon creation in ArrayBasedMapBuilder. Currently a map with keys 0.0 and -0.0 will behave as if they are separate values. This will cause issues when doing GROUP BY on map types.

Refer to this conversion https://github.com/apache/spark/pull/45549#discussion_r1537803505

Issue Links

• links to: GitHub Pull Request #45721