Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3321

AVRO: Support user specified schema on load

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • piggybank

    Description

      It would be useful for users to be able to explicitly specify the schema to use for reading avro input. This allows users to exactly specify how to resolve inputs with multiple schemas, rather than depending on the guessing done when 'multiple_schemas' is set.

      Attachments

        1. 3321_trunk_postInspection.patch
          15 kB
          Harvey Chong
        2. testUserDefinedLoadSchema_input2.avro
          0.4 kB
          Harvey Chong
        3. testUserDefinedLoadSchema_input1.avro
          0.4 kB
          Harvey Chong
        4. expected_testUserDefinedLoadSchema.avro
          0.6 kB
          Harvey Chong
        5. 3321.patch
          16 kB
          Harvey Chong

        Activity

          People

            harveyc Harvey Chong
            harveyc Harvey Chong
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified