Uploaded image for project: 'Apache HAWQ'
  1. Apache HAWQ
  2. HAWQ-1265

Support Complex Hive Schema's

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Hcatalog, PXF
    • Labels:
      None

      Description

      Currently if in hive you have Avro or other formats, where the schema is complex, you cannot currently query the fields in the complex object via hcatalog/pxf integration.

      In terms of Avro Schema - records, enums and complex arrays, do not work.

      Hive fully supports this complex/object notation, as does many of the other SQL tools in the Hadoop eco-system (Spark, Impala, Drill).

      These all seem to support the same styled solution of using dots for complex object/path negotiation:

      SELECT schema.table.fieldA.nestedRecordFieldS FROM myavrotable;

        Attachments

          Activity

            People

            • Assignee:
              odiachenko Oleksandr Diachenko
              Reporter:
              michael.andre.pearce Michael Andre Pearce
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: