[AVRO-3869] Error parsing fixed logical schemas

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.11.2
• Component/s: csharp
• Labels: Parsing avro c# pull-request-available
• Flags: Important
• Docs Text: https://avro.apache.org/docs/1.11.1/specification/#decimal

Language

C#

• Assignee: Unassigned
• Reporter: Paulo Humberto Lacerda e Silva
• Created: 21/Sep/23 00:33
• Updated: 21/Sep/23 04:10

Description

Logical types works only for primitive types, and I can't deserialize an fixed type, like this one:

 

{
 "type": "fixed",
 "name": "LogicalFixed",
 "logicalType": "decimal",
 "precision": 4,
 "scale": 2,
  "size": 10
}

An exception is SchemaParseException raised ("Undefined name: fixed at 'type'")

This schema is autogenerated by PySpark, from a decimal type, and can't be parsed.
Spark docs: https://spark.apache.org/docs/latest/sql-data-sources-avro.html

 

Issue Links

• is part of: AVRO-3570 Logical type with "fixed" type not interoperable
• links to: GitHub Pull Request #2512