[HBASE-20894] Move BucketCache from java serialization to protobuf - ASF JIRA

XML

Word

Printable

JSON

Hadoop Flags:

Incompatible change
Release Note:

Hide
For users who have configured hbase.bucketcache.ioengine with either the file:, files:, or mmap: prefix, and configured it to be persistent via the hbase.bucketcache.persistent.path property, the serialization format of the bucket cache has changed between versions. The old state will not be read during startup, and there is currently no migration path. The impact is expected to be minimal, however, since the cache will rebuild over time as access patterns dictate.

Show
For users who have configured hbase.bucketcache.ioengine with either the file:, files:, or mmap: prefix, and configured it to be persistent via the hbase.bucketcache.persistent.path property, the serialization format of the bucket cache has changed between versions. The old state will not be read during startup, and there is currently no migration path. The impact is expected to be minimal, however, since the cache will rebuild over time as access patterns dictate.

We should use a better serialization format instead of Java Serialization for the BucketCache entry persistence.

Suggested by Chris McCown, who does not appear to have a JIRA account.

0001-Write-the-CacheableDeserializerIdManager-index-into-.patch
28/Jul/18 21:12
13 kB
Michael Stack
HBASE-20894.master.001.patch
20/Jul/18 19:14
19 kB
Mike Drob
HBASE-20894.master.002.patch
25/Jul/18 21:56
20 kB
Mike Drob
HBASE-20894.master.003.patch
27/Jul/18 20:57
24 kB
Mike Drob
HBASE-20894.master.004.patch
31/Jul/18 18:38
37 kB
Mike Drob
HBASE-20894.master.005.patch
01/Aug/18 17:01
37 kB
Mike Drob
HBASE-20894.master.006.patch
01/Aug/18 18:43
37 kB
Mike Drob
HBASE-20894.WIP.patch
16/Jul/18 17:22
3 kB
Mike Drob
HBASE-20894.WIP-2.patch
16/Jul/18 19:43
13 kB
Mike Drob

is related to

HBASE-21027 Inconsistent synchronization in CacheableDeserializerIdManager

links to

Review Board (master)