[PIG-3297] Avro files with stringType set to String cannot be read by the AvroStorage LoadFunc

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11.1
• Fix Version/s: 0.12.0
• Component/s: piggybank

Release Note

Read Avro files that have string fields that were written with avro.java.string = String

• Assignee: Niels Basjes
• Reporter: Niels Basjes
• Created: 25/Apr/13 08:42
• Updated: 14/Oct/13 16:46
• Resolved: 21/May/13 22:11

Description

When an Avro file is created there exists the option to set the "String Type" to a different class than the default Utf8.
A very common situation is that the "String Type" is set to the default String class.

When trying to read such an Avro file in Pig using the AvroStorage LoadFunc from the included piggybank this gives the following Exception:

Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.avro.util.Utf8
at org.apache.pig.piggybank.storage.avro.PigAvroDatumReader.readString(PigAvroDatumReader.java:154)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:150)

Issue Links

• is blocked by: PIG-3332 Upgrade Avro dependency to 1.7.4