Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11201

HCatalog is ignoring user specified avro schema in the table definition

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.2.0, 1.2.1
    • Fix Version/s: 2.0.0
    • Component/s: HCatalog
    • Labels:
      None
    • Target Version/s:

      Description

      HCatalog is ignoring user specified avro schema in the table definition , instead generating its own avro based from hive meta store.

      By generating its own schema will result in mismatch names. For exmple Avro fields name are Case Sensitive. By generating it's own schema will result in incorrect schema written to the avro file , and result select fail on read. And also Even if user specified schema does not allow null , when data is written using Hcatalog , it will write a schema that will allow null.

      For example in the table , user specified , all CAPITAL letters in the schema , and record name as LINEITEM. The schema should be written as it is. Instead Hcatalog ignores it and generated its own avro schema from the hive table case.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                libing Bing Li
                Reporter:
                libing Bing Li
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: