Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2129

Catalogd support to load only table/column metadata

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.0
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:

      Description

      In order to implement IMPALA-1761 (exposing catalog metadata as tables), we need the ability to load table and column metadata without loading all partition metadata and file metadata which can be very expensive and slow.

      This would mean that the catalog server needs to be able to load metastore tables and columns alone (see HdfsTable.load()) and exposes a call to do so from impalad backends (see CatalogService.thrift).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                mjacobs Matthew Jacobs
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: