Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
In the context of distributed spark env, we need to firstly ship the necessary functions and variables to the remote workers and then to initialize and register the cleanup of buffer pool for each remote worker. All these are inspired by the parfor implementation.
Attachments
Issue Links
- Is contained by
-
SYSTEMDS-2087 Initial version of distributed spark backend
- Resolved