[ARROW-4421] [Flight][C++] Handle large Flight data messages

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Component/s: C++, FlightRPC
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/20983
• Assignee: David Li
• Reporter: Wes McKinney
• Created: 29/Jan/19 22:43
• Updated: 11/Jan/23 07:33
• Resolved: 13/Mar/19 01:22

Description

I believe the message payloads are currently limited to 4MB by default, see one developer's discussion here:

https://nanxiao.me/en/message-length-setting-in-grpc/

While it is a good idea to break large messages into smaller ones, we will need to address how to gracefully send larger payloads that may be provided by a user's server implementation. Either we can increase the limit or break up the record batches into smaller chunks in the Flight server base (or both, of course)

Issue Links

• links to: GitHub Pull Request #3878