[ARROW-16124] [C++][FlightRPC] UCX server should be able to shed load

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++, FlightRPC
• External issue URL: https://github.com/apache/arrow/issues/31533
• Assignee: Unassigned
• Reporter: David Li
• Created: 05/Apr/22 14:53
• Updated: 11/Jan/23 11:42

Description

The UCX server from ARROW-15706 will accept connections and put them into a queue to be handled. If they aren't handled quickly enough this can lead to a lot of clients stuck waiting for the server. The server should reject connections if too many pile up so the client can error or retry or connect to a different server. (This is a pitfall of gRPC/Java that we should avoid here.)

Issue Links

• is related to: ARROW-15706 [C++][FlightRPC] Implement a UCX transport