[IMPALA-3977] TransmitData() should not block.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: Impala 2.7.0
• Component/s: Distributed Exec
• Labels: rpc
• Target Version: Product Backlog
• Assignee: Sailesh Mukil
• Reporter: Henry Robinson
• Created: 15/Aug/16 21:45
• Updated: 30/Oct/17 16:56
• Resolved: 30/Oct/17 16:56

Description

TransmitData() calls effectively block until an error occurs (e.g. datastream_sender_timeout_ms expires) or the RPC is serviced by the receiver.

This is bad for a variety of reasons, not least that it makes it impossible to cancel the sender without also cancelling the recipient (who might not even be running!).

Instead, we should have TransmitData() return control to the caller with an EAGAIN-like error so that the row batch can be resent in the future if the caller decides to do so.

Issue Links

• Is contained by: IMPALA-4856 Port datastream portions of ImpalaInternalService to KRPC