[SPARK-5681] Calling graceful stop() immediately after start() on StreamingContext should not get stuck indefinitely

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: DStreams
• Assignee: Shixiong Zhu
• Reporter: L. C. Hsieh
• Created: 09/Feb/15 07:44
• Updated: 17/Jul/15 21:01
• Resolved: 17/Jul/15 21:01

Description

Sometimes the receiver will be registered into tracker after ssc.stop is called. Especially when stop() is called immediately after start(). So the receiver doesn't get the StopReceiver message from the tracker. In this case, when you call stop() in graceful mode, stop() would get stuck indefinitely.

Issue Links

• is duplicated by: SPARK-7346 Fix a bug that ssc.stop(true, stopGracefully = true) may block forever
• is duplicated by: SPARK-5615 Fix testPackage in StreamingContextSuite
• links to: [Github] Pull Request #4467 (viirya)
• links to: [Github] Pull Request #6294 (zsxwing)
• links to: [Github] Pull Request #7276 (zsxwing)