[HIVE-14794] HCatalog support to pre-fetch schema for Avro tables that use avro.schema.url.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.2.1, 2.1.0
• Component/s: HCatalog
• Assignee: Mithun Radhakrishnan
• Reporter: Mithun Radhakrishnan
• Created: 19/Sep/16 23:24
• Updated: 19/Sep/16 23:30

Description

HIVE-14792 introduces support to modify and add properties to table-parameters during query-planning. It prefetches remote Avro-schema information and stores it in TBLPROPERTIES, under avro.schema.literal.

We'll need similar support in HCatLoader to prevent excessive reads of schema-files in Pig queries.

Issue Links

• depends upon: HIVE-14792 AvroSerde reads the remote schema-file at least once per mapper, per table reference.