Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3321

AVRO: Support user specified schema on load

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0
    • Component/s: piggybank
    • Labels:

      Description

      It would be useful for users to be able to explicitly specify the schema to use for reading avro input. This allows users to exactly specify how to resolve inputs with multiple schemas, rather than depending on the guessing done when 'multiple_schemas' is set.

        Attachments

        1. 3321_trunk_postInspection.patch
          15 kB
          Harvey Chong
        2. testUserDefinedLoadSchema_input2.avro
          0.4 kB
          Harvey Chong
        3. testUserDefinedLoadSchema_input1.avro
          0.4 kB
          Harvey Chong
        4. expected_testUserDefinedLoadSchema.avro
          0.6 kB
          Harvey Chong
        5. 3321.patch
          16 kB
          Harvey Chong

          Activity

            People

            • Assignee:
              harveyc Harvey Chong
              Reporter:
              harveyc Harvey Chong
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified