[SPARK-40778] Make HeartbeatReceiver as an IsolatedRpcEndpoint

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.4.0
• Component/s: Spark Core
• Assignee: Zhongwei Zhu
• Reporter: Zhongwei Zhu
• Created: 13/Oct/22 03:58
• Updated: 20/Oct/22 09:38
• Resolved: 20/Oct/22 09:38

Description

All RpcEndpoint including HeartbeatReceiver in driver are sharing one thread pool. When there're lots of rpc messages queued, the waiting process time of heartbeat time could easily exceed heartbeat timeout. Make HeartbeatReceiver extends IsolatedRcpEndpoint then it has dedicated single thread to process heartbeat

Issue Links

• links to: [Github] Pull Request #38231 (warrenzhu25)
• links to: [Github] Pull Request #38231 (warrenzhu25)