[SPARK-27419] When setting spark.executor.heartbeatInterval to a value less than 1 seconds, it will always fail

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0, 2.4.1
• Fix Version/s: 2.4.2
• Component/s: Spark Core
• Labels: release-notes
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 09/Apr/19 17:32
• Updated: 22/Apr/19 04:05
• Resolved: 10/Apr/19 16:43

Description

When setting spark.executor.heartbeatInterval to a value less than 1 seconds in branch-2.4, it will always fail because the value will be converted to 0 and the heartbeat will always timeout and finally kill the executor.

Issue Links

• is related to: SPARK-27198 Heartbeat interval mismatch in driver and executor
• links to: GitHub Pull Request #24329
• links to: GitHub Pull Request #24432