Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3547

Bound the size of Impalad catalog cache

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: Impala 2.5.0
    • Fix Version/s: None
    • Component/s: Catalog

      Description

      Currently the catalog cache of every Impalad holds a replica of the entire catalog. In certain scenarios (e.g. large metadata), the local catalog cache is using memory that could be used more effectively elsewhere. We should consider changing the impalad catalog cache into a proper cache with a configurable size limit and an invalidation mechanism.

        Attachments

          Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-7127 Fetch-on-demand metadata for the impalad-side catalog

          • Major - Major loss of function.
          • Reopened

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                dtsirogiannis Dimitris Tsirogiannis
              • Votes:
                1 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: