[IMPALA-4874] Increase maximum KRPC message size

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.9.0
• Fix Version/s: Impala 2.12.0
• Component/s: Distributed Exec
• Target Version: Product Backlog
• Assignee: Joe McDonnell
• Reporter: Henry Robinson
• Created: 03/Feb/17 00:36
• Updated: 05/May/19 04:32
• Resolved: 21/Feb/18 23:37

Description

KRPC has a natural maximum message size (controlled by --rpc_max_message_size), but also uses Protobuf in such a way as the maximum message size is separately restricted to 512MB.

Although Impala should try and avoid any payloads of this size, realistically we may not get rid of all of them by Impala 2.9.0. For now, let's increase the max message size while at the same time working to reduce the actual payload size created by Impala.