[ATLAS-409] Atlas will not import avro tables with schema read from a file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6-incubating
• Fix Version/s: 0.7-incubating
• Assignee: Aaron Dossett
• Reporter: Aaron Dossett
• Created: 21/Dec/15 19:59
• Updated: 22/Jun/16 10:03
• Resolved: 19/Jan/16 06:10

Description

Atlas won't import a Hive table with no columns (see below for an example of a valid hive table with no explicit columns). This is because the Atlas Hive Storage Descriptor class REQUIRES columns, but the Hive Table class allows them to be OPTIONAL.

CREATE TABLE example
  ROW FORMAT SERDE
  'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
  STORED AS INPUTFORMAT
  'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
  OUTPUTFORMAT
  'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
  TBLPROPERTIES (
    'avro.schema.url'='file:///path/to/the/schema/test_serializer.avsc');