[SPARK-28160] TransportClient.sendRpcSync may hang forever

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.3, 2.4.3, 3.0.0
• Fix Version/s: 2.3.4, 2.4.4, 3.0.0
• Component/s: Spark Core
• Assignee: Lantao Jin
• Reporter: Lantao Jin
• Created: 25/Jun/19 09:51
• Updated: 30/Jun/19 20:20
• Resolved: 30/Jun/19 20:19

Description

This is very like SPARK-26665
`ByteBuffer.allocate` may throw OutOfMemoryError when the response is large but no enough memory is available. However, when this happens, TransportClient.sendRpcSync will just hang forever if the timeout set to unlimited.

Issue Links

• links to: GitHub Pull Request #24964