Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Spark has added explicit termination api for broadcasts in 1.1. So broadcast variables are now closeable by driver.
Spark 1.2 seems to have done this change a bit moot since it is using reference queues to shut off broadcasts (and caches) automatically now.