[HDDS-3924] Move away from proto serialization for RocksDB keys in Ozone

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Target Version/s: 1.0.0
• Assignee: Aravindan Vijayan
• Reporter: Aravindan Vijayan
• Created: 06/Jul/20 13:51
• Updated: 16/Jul/20 21:05
• Resolved: 16/Jul/20 21:05

Description

Currently there are a few places where we rely on protobuf serialization to convert the key type to byte array for a RocksDB column family 'key'. However, from the proto documentation it looks like the serialization of proto is unreliable (especially across versions). If the byte[] got from proto serialization changes, this will be a problem since old keys will be unreadable.

Thanks to arp who helped unearth this problem.

Sub-Tasks

• SCM Pipeline DB should directly use UUID bytes for key rather than rely on proto serialization for key.: Resolved
• Ozone Manager Token Identifier table should use in-house serialization rather than rely on proto serialization for key.: Resolved