[HDDS-11414] Key listing for FSO buckets fails with forward client

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 2.0.0, 1.4.1
• Labels: pull-request-available
• Target Version/s: 2.0.0
• Assignee: Tanvi Penumudy
• Reporter: Tanvi Penumudy
• Created: 05/Sep/24 07:00
• Updated: 25/Oct/24 13:59
• Resolved: 09/Sep/24 07:32

Description

The change introduced in HDDS-7715 (PR #5275) brings a lighter-weight lightStatusLight API for the o3 CLI (ozone sh key list) and S3 ListObject requests. Meanwhile, the ofs/o3fs commands will continue to use the older listStatus API.

The change aimed to improve performance, particularly during large-scale key listing, by reducing the overhead during serialization/deserialization of information such as KeyLocations, which are not very useful on the client side (except in some cases for the ofs/o3fs client). A trimmed KeyInfo object, [BasicKeyInfo], is used in listStatusLight.

The change causes a compatibility issue when an older server (without this change) is used alongside a newer client (with this change) for FSO buckets:

<newer-client-path>/bin/ozone sh key list o3://<om-service-id>/vol1/fso-buc

Error stacktrace:
 E           AssertionError: Ozone list Key failed with output=[	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           	at com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
E           	at com.google.protobuf.AbstractParser.checkMessageInitialized(AbstractParser.java:71)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:89)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:95)
E           	at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
E           24/08/28 19:22:29 ERROR ha.OMFailoverProxyProviderBase: Failed to connect to OMs: [om136, om134, om135]. Attempted 50 failovers.
E           Message missing required fields: cmdType]

Issue Links

• is related to: HDDS-11596 Add Feature Bitmap to OzoneManagerVersion for Compatibility Checks
• is related to: HDDS-7715 keyManagerImpl#listStatus exceeds the maximum RPC length
• relates to: HDDS-11607 Improve compatibility of listStatusLight
• links to: GitHub Pull Request #7161