[HDDS-5243] Return latest version of key location for client

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.2.0
• Labels: pull-request-available
• Assignee: Janus Chow
• Reporter: Janus Chow
• Created: 18/May/21 15:14
• Updated: 09/Jul/21 09:41
• Resolved: 09/Jul/21 09:41

Description

Currently, OmKeyInfo uses a `keyLocationVersions: List<OmKeyLocationInfoGroup>` to store all versions of KeyLocation information. If a key has lots of versions, OM needs to reply all the content of `keyLocationVersions` to the client, which may cause the following IPC warning, when the size exceeds the client IPC response size limit becomes an error.

2021-05-18 23:10:07,246 [IPC Server handler 97 on default port 9862] WARN org.apache.hadoop.ipc.Server: Large response size 20541123 for call Call#3 Retry#0 org.apache.hadoop.ozone.om.protocol.OzoneManagerProtocol.submitRequest from 10.130.20.239:46306

This ticket is to add an config for client to only query the latest content in `keyLocationVersions`, which can reduce the IPC response size and improve OM's performance by excluding lots of unnecessary work with old key locations.

Issue Links

• is depended upon by: HDDS-5393 Return latest version of key location for client on createKey/createFile
• links to: GitHub Pull Request #2261