Uploaded image for project: 'Avro'
  1. Avro
  2. AVRO-592

Pig to Avro translation -- Pig DatumReader/Writer

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: java
    • Labels:
      None

      Description

      It would be great to use Avro to store Pig outputs. Because Avro persists the schema as well, one can store data in one script, then load it in another and preserve the schema.

      Additionally, one can serialize pig Tuples to Avro and read Avro into pig Tuples. Avro Schemas are significantly more rich than Pig schemas, but a limited translation is possible.

        Attachments

          Activity

            People

            • Assignee:
              scott_carey Scott Carey
              Reporter:
              scott_carey Scott Carey
            • Votes:
              2 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated: