Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3159

Update AvroSerde to determine schema of new tables

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.12.0
    • None
    • Serializers/Deserializers
    • None

    Description

      Currently when writing tables to Avro one must manually provide an Avro schema that matches what is being delivered by Hive. It'd be better to have the serde infer this schema by converting the table's TypeInfo into an appropriate AvroSchema.

      Attachments

        1. HIVE-3159.10.patch
          95 kB
          Mohammad Islam
        2. HIVE-3159.4.patch
          51 kB
          Mohammad Islam
        3. HIVE-3159.5.patch
          47 kB
          Mohammad Islam
        4. HIVE-3159.6.patch
          47 kB
          Mohammad Islam
        5. HIVE-3159.7.patch
          44 kB
          Mohammad Islam
        6. HIVE-3159.9.patch
          95 kB
          Mohammad Islam
        7. HIVE-3159v1.patch
          41 kB
          Mohammad Islam

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. HIVE-7049 Unable to deserialize AVRO data when file schema and record schema are different and nullable

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-6806 CREATE TABLE should support STORED AS AVRO

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              kamrul Mohammad Islam
              jghoman Jakob Homan
              Votes:
              1 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: