Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3234

Catalog should send incremental metadata changes to Impalads

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.5.0
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:

      Description

      Currently, every table metadata change (DDL/DML operation) causes the catalog to serialize the entire table metadata and send it to: a) the impalad node that triggered the operation and b) all the impalad nodes via a statestore update. The catalog should instead send only the portion of the table metadata that changed. Furthermore, certain operations, like DESCRIBE statements, don't require the full table metadata.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                dtsirogiannis Dimitris Tsirogiannis
              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated: