[SPARK-5065] BroadCast can still work after sc had been stopped.

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.1
• Component/s: Spark Core
• Assignee: Josh Rosen
• Reporter: Zhaowei Huang
• Created: 04/Jan/15 02:48
• Updated: 17/Feb/15 22:21
• Resolved: 17/Feb/15 22:21

Description

Code as follow:

val sc1 = new SparkContext
val sc2 = new SparkContext
sc1.stop
sc1.broadcast(1)

It can work well, because sc1.broadcast will reuse the BlockManager in sc2.
To fix it, throw a sparkException when broadCastManager had stopped.

Issue Links

• relates to: SPARK-5063 Display more helpful error messages for several invalid operations
• links to: [Github] Pull Request #3885 (SaintBacchus)