Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
0.2.0
-
None
-
None
Description
We would like to use Avro serialization in Pig to pass data between MR jobs instead of the current BinStorage. Attached is an implementation of AvroBinStorage which performs significantly better compared to BinStorage on our benchmarks.