Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-1628

Improve synchronization protocol in the catalog

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 2.0.1, Impala 2.3.0
    • None
    • Catalog

    Description

      Currently, the locking protocol used in the catalog is ad-hoc, hard to reason about, and doesn't provide well defined consistency guarantees. The lock-based protocol that is currently used is causing long writers (e.g. REFRESH) to block readers and the granularity of locks used is too coarse. We should reconsider the synchronization protocol used to protect the internal state of catalog objects. Different options could include:

      • Hierarchical locking
      • MVCC 

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-3127 Decouple partitions from tables

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-2423 Concurrent operations on the same partitioned table may cause stale partition metadata

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              dtsirogiannis Dimitris Tsirogiannis
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: