Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4161

Make Hive Metastore client caching user configurable.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: None
    • Labels:

      Description

      Drill leverages LoadingCache in hive metastore client, in order to avoid the long access time to hive metastore server. However, there is a tradeoff between caching stale data and the possibility of cache hit.

      For instance, DRILL-3893 changes cache invalidation policy to "1 minute after last write", to avoid the chances of hitting stale data. However, it also implies that the cached data would be only valid for 1 minute after loading/write.

      It's desirable to allow user to configure the caching policy, per their individual use case requirement. In particular, we probably should allow user to specify:
      1) caching invalidation policy : expire after last access, or expire after last write.
      2) cache TTL.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jni Jinfeng Ni
              Reviewer:
              Rahul Kumar Challapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: