[HDFS-11026] Convert BlockTokenIdentifier to use Protobuf

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.9.0, 3.0.0-alpha1
• Fix Version/s: 3.0.0-alpha4
• Component/s: hdfs, hdfs-client
• Hadoop Flags: Reviewed

Release Note

Changed the serialized format of BlockTokenIdentifier to protocol buffers. Includes logic to decode both the old Writable format and the new PB format to support existing clients. Client implementations in other languages will require similar functionality.

• Assignee: Ewan Higgs
• Reporter: Ewan Higgs
• Created: 18/Oct/16 13:31
• Updated: 13/Feb/17 20:01
• Resolved: 13/Feb/17 19:39

Description

BlockTokenIdentifier currently uses a DataInput/DataOutput (basically a byte[]) and manual serialization to get data into and out of the encrypted buffer (in BlockKeyProto). Other TokenIdentifiers (e.g. ContainerTokenIdentifier, AMRMTokenIdentifier) use Protobuf. The BlockTokenIdenfitier should use Protobuf as well so it can be expanded more easily and will be consistent with the rest of the system.

Issue Links

• is related to: HDFS-11096 Support rolling upgrade between 2.x and 3.x
• is required by: HDFS-6708 StorageType should be encoded in the block token