Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3321

AVRO: Support user specified schema on load

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0
    • Component/s: piggybank
    • Labels:

      Description

      It would be useful for users to be able to explicitly specify the schema to use for reading avro input. This allows users to exactly specify how to resolve inputs with multiple schemas, rather than depending on the guessing done when 'multiple_schemas' is set.

      1. 3321_trunk_postInspection.patch
        15 kB
        Harvey Chong
      2. 3321.patch
        16 kB
        Harvey Chong
      3. expected_testUserDefinedLoadSchema.avro
        0.6 kB
        Harvey Chong
      4. testUserDefinedLoadSchema_input1.avro
        0.4 kB
        Harvey Chong
      5. testUserDefinedLoadSchema_input2.avro
        0.4 kB
        Harvey Chong

        Activity

        Hide
        harveyc Harvey Chong added a comment -

        diff of changes and files for new test

        Show
        harveyc Harvey Chong added a comment - diff of changes and files for new test
        Hide
        rohini Rohini Palaniswamy added a comment -

        Review request for this patch from Harvey - https://reviews.apache.org/r/11155/

        Show
        rohini Rohini Palaniswamy added a comment - Review request for this patch from Harvey - https://reviews.apache.org/r/11155/
        Hide
        rohini Rohini Palaniswamy added a comment -

        +1. Committed to trunk (0.12). Thanks Harvey.

        Show
        rohini Rohini Palaniswamy added a comment - +1. Committed to trunk (0.12). Thanks Harvey.

          People

          • Assignee:
            harveyc Harvey Chong
            Reporter:
            harveyc Harvey Chong
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 48h
              48h
              Remaining:
              Remaining Estimate - 48h
              48h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development