[CHUKWA-452] ChukwaArchive byte[] needs to be wrapped in DataByteArray

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.0
• Tags: CHUKWA-452.patch
• Assignee: Unassigned
• Reporter: Gerrit Jansen van Vuuren
• Created: 09/Feb/10 13:01
• Updated: 29/Mar/10 16:23
• Resolved: 09/Feb/10 19:54

Description

I've been trying to read the data inserted into /chukwa/finalArchives using the ChukwaArchive Loader in pig.
On trying to STORE only the data field using BinaryStore I get:

FAILED

java.lang.ClassCastException: [B cannot be cast to org.apache.pig.data.DataByteArray
at org.apache.pig.builtin.BinaryStorage.putNext(BinaryStorage.java:128)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:200)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:174)
at org.apache.hadoop.mapred.MapTask$DirectMapOutputCollector.collect(MapTask.java:642)
at org.apache.hadoop.mapred.MapTask$OldOutputCollector.collect(MapTask.java:466)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.collect(PigMapOnly.java:70)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:255)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:244)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:65)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)

Looking at the ChukwaArchive class I saw that the data:byte[] is set to the Tuple without wrapping to DataByteArray.
The patch I'm submitting applies this change by wrapping the data:byte[] with the DataByteArray class.