[PARQUET-765] Upgrade Avro to 1.8.1

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.10.0
• Component/s: parquet-avro
• Assignee: Gabor Szadovszky
• Reporter: Gabor Szadovszky
• Created: 05/Nov/16 15:33
• Updated: 29/Nov/16 08:22
• Resolved: 09/Nov/16 17:02

Description

Unit test failure occurs if using Avro 1.8.1:

[ERROR] Failed to execute goal org.apache.avro:avro-maven-plugin:1.8.1:idl-protocol (schemas) ... 
org.apache.avro.compiler.idl.ParseException: Encountered " "date" "date "" at line 23, column 14.
[ERROR] Was expecting one of:
[ERROR] <IDENTIFIER> ...
[ERROR] "@" ...
[ERROR] "`" ...
[ERROR] -> [Help 1]

See AVRO-1924 about the background.
It is not clear whether it is solvable on Avro side or it is more a limitation from Avro 1.8.1. Therefore, I would suggest fixing the issue in the unit test side.

Issue Links

• is related to: AVRO-1924 Variable named 'date' in IDL
• is related to: PARQUET-725 Parquet AVRO tests fail when debug logging is enabled
• links to: Pull request