[HDDS-5404] upgrade protobuf to proto3

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Mukul Kumar Singh Assign to me
• Reporter: Mukul Kumar Singh
• Created: 01/Jul/21 13:36
• Updated: 19/Aug/22 12:31

Description

There are several vulnerebaltiies with protobuf 2.5.0 compilation we currently use with Hadoop RPC. This jira proposes to move protobuf compilation to use proto3. Also this also will move Hadoop RPC to use proto3 as well.

https://issues.apache.org/jira/browse/HADOOP-16596

Issue Links

• is blocked by: HDDS-3292 Support Hadoop 3.3
• is duplicated by: HDDS-903 Compile OzoneManager Ratis protobuf files with proto3 compiler

Sub-Tasks

• Refactor pom files for HadoopRpc and Grpc/Ratis compilation properties: Resolved
• add proto version to all the proto files: Resolved
• rename hadooprpc proto compilation in pom to refer to proto2: Resolved
• compile both proto2 and proto3 versions of Client to OM interation proto files: Resolved
• use proto3 as the compilation version for all the proto files: Open
• Move ozone csi to use hadoop thirdparty protobuf compiled version: Open
• Add tests for interoperability between older clients and new server implemetation: Open
• Add new Hadoop33 Transport: Open
• Harmonize protobuf version used: Open
• Avoid using GeneratedMessage in non-generated code: Resolved