[SPARK-34229] Avro should read decimal values with the file schema

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.4.7, 3.0.1, 3.1.1, 3.2.0
• Fix Version/s: 2.4.8, 3.0.2, 3.1.1
• Component/s: SQL
• Labels: correctness
• Target Version/s: 2.4.8, 3.0.2, 3.1.1
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 25/Jan/21 20:32
• Updated: 12/Dec/22 18:10
• Resolved: 26/Jan/21 05:32

Description

scala> sql("SELECT 3.14 a").write.format("avro").save("/tmp/avro")
scala> spark.read.schema("a DECIMAL(4, 3)").format("avro").load("/tmp/avro").show
+-----+
|    a|
+-----+
|0.314|
+-----+ 

Issue Links

• links to: [Github] Pull Request #31329 (dongjoon-hyun)