Uploaded image for project: 'Apache HAWQ'
  1. Apache HAWQ
  2. HAWQ-1265

Support Complex Hive Schema's

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Hcatalog, PXF
    • None

    Description

      Currently if in hive you have Avro or other formats, where the schema is complex, you cannot currently query the fields in the complex object via hcatalog/pxf integration.

      In terms of Avro Schema - records, enums and complex arrays, do not work.

      Hive fully supports this complex/object notation, as does many of the other SQL tools in the Hadoop eco-system (Spark, Impala, Drill).

      These all seem to support the same styled solution of using dots for complex object/path negotiation:

      SELECT schema.table.fieldA.nestedRecordFieldS FROM myavrotable;

      Attachments

        Activity

          People

            odiachenko Oleksandr Diachenko
            michael.andre.pearce Michael Andre Pearce
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: