Avro
  1. Avro
  2. AVRO-592

Pig to Avro translation -- Pig DatumReader/Writer

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: java
    • Labels:
      None

      Description

      It would be great to use Avro to store Pig outputs. Because Avro persists the schema as well, one can store data in one script, then load it in another and preserve the schema.

      Additionally, one can serialize pig Tuples to Avro and read Avro into pig Tuples. Avro Schemas are significantly more rich than Pig schemas, but a limited translation is possible.

      1. AVRO-592.patch
        63 kB
        Scott Carey

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Scott Carey
            Reporter:
            Scott Carey
          • Votes:
            2 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:

              Development