[IMPALA-2129] Catalogd support to load only table/column metadata

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 2.0
• Component/s: Catalog
• Labels: catalog-server
• Epic Link: fine-grained metadata in catalogd
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Matthew Jacobs
• Created: 07/Jul/15 22:35
• Updated: 21/Aug/23 09:10

Description

In order to implement IMPALA-1761 (exposing catalog metadata as tables), we need the ability to load table and column metadata without loading all partition metadata and file metadata which can be very expensive and slow.

This would mean that the catalog server needs to be able to load metastore tables and columns alone (see HdfsTable.load()) and exposes a call to do so from impalad backends (see CatalogService.thrift).

Issue Links

• is related to: IMPALA-3234 Catalog should send incremental metadata changes to Impalads