[HIVE-18661] CachedStore: Use metastore notification log events to update cache - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: None
Component/s: Metastore
Labels:
- pull-request-available

Description

Currently, a background thread updates the entire cache which is pretty inefficient. We capture the updates to metadata in NOTIFICATION_LOG table which is getting used in the Replication work. We should have the background thread apply these notifications to incrementally update the cache.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-18661.02.patch
29/Oct/18 13:37
656 kB
mahesh kumar behera
HIVE-18661.03.patch
05/Nov/18 03:00
656 kB
mahesh kumar behera
HIVE-18661.04.patch
08/Nov/18 07:52
671 kB
mahesh kumar behera
HIVE-18661.05.patch
09/Nov/18 11:48
673 kB
mahesh kumar behera
HIVE-18661.06.patch
13/Nov/18 03:55
684 kB
mahesh kumar behera
HIVE-18661.07.patch
13/Nov/18 05:10
685 kB
mahesh kumar behera
HIVE-18661.08.patch
13/Dec/18 10:28
195 kB
mahesh kumar behera
HIVE-18661.09.patch
17/Dec/18 02:44
208 kB
mahesh kumar behera

Issue Links

links to

GitHub Pull Request #479

Activity

People

Assignee:: mahesh kumar behera

Reporter:: Vaibhav Gumashta

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 08/Feb/18 23:27

Updated:: 16/Jun/20 16:52

Resolved:: 18/Dec/18 08:29

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

20m