Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3124

Add external metadata notification mechanisms to Impala

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.2.4
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:

      Description

      Currently, users needs to run refresh/invalidate metadata to update metadata when data (files, blocks) and/or metadata (tables, partitions) are modified externally. These operation cause many consistency and performance issues. We should add external metadata notification mechanism (e.g. inotify or HMS listeners) so that the catalog server can automatically sync metadata as they change.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              dtsirogiannis Dimitris Tsirogiannis
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated: