Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
Impala 2.5.0
-
None
Description
Currently, every table metadata change (DDL/DML operation) causes the catalog to serialize the entire table metadata and send it to: a) the impalad node that triggered the operation and b) all the impalad nodes via a statestore update. The catalog should instead send only the portion of the table metadata that changed. Furthermore, certain operations, like DESCRIBE statements, don't require the full table metadata.
Attachments
Issue Links
- duplicates
-
IMPALA-4967 Metadata distribution should be incremental
- Resolved
- is blocked by
-
IMPALA-3127 Decouple partitions from tables
- Resolved
- relates to
-
IMPALA-2129 Catalogd support to load only table/column metadata
- Open