Pig
  1. Pig
  2. PIG-3321

AVRO: Support user specified schema on load

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0
    • Component/s: piggybank
    • Labels:

      Description

      It would be useful for users to be able to explicitly specify the schema to use for reading avro input. This allows users to exactly specify how to resolve inputs with multiple schemas, rather than depending on the guessing done when 'multiple_schemas' is set.

      1. testUserDefinedLoadSchema_input2.avro
        0.4 kB
        Harvey Chong
      2. testUserDefinedLoadSchema_input1.avro
        0.4 kB
        Harvey Chong
      3. expected_testUserDefinedLoadSchema.avro
        0.6 kB
        Harvey Chong
      4. 3321.patch
        16 kB
        Harvey Chong
      5. 3321_trunk_postInspection.patch
        15 kB
        Harvey Chong

        Activity

        Hide
        Harvey Chong added a comment -

        diff of changes and files for new test

        Show
        Harvey Chong added a comment - diff of changes and files for new test
        Hide
        Rohini Palaniswamy added a comment -

        Review request for this patch from Harvey - https://reviews.apache.org/r/11155/

        Show
        Rohini Palaniswamy added a comment - Review request for this patch from Harvey - https://reviews.apache.org/r/11155/
        Hide
        Rohini Palaniswamy added a comment -

        +1. Committed to trunk (0.12). Thanks Harvey.

        Show
        Rohini Palaniswamy added a comment - +1. Committed to trunk (0.12). Thanks Harvey.

          People

          • Assignee:
            Harvey Chong
            Reporter:
            Harvey Chong
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 48h
              48h
              Remaining:
              Remaining Estimate - 48h
              48h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development