Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
It would be great to use Avro to store Pig outputs. Because Avro persists the schema as well, one can store data in one script, then load it in another and preserve the schema.
Additionally, one can serialize pig Tuples to Avro and read Avro into pig Tuples. Avro Schemas are significantly more rich than Pig schemas, but a limited translation is possible.