[SPARK-24403] reuse r worker

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.3.0
• Component/s: SparkR
• Labels: sparkR
• Assignee: Unassigned
• Reporter: Deepansh
• Shepherd: Felix Cheung
• Created: 28/May/18 11:48
• Updated: 05/Jun/18 01:47
• Resolved: 05/Jun/18 01:47

Description

Currently, SparkR doesn't support reuse of its workers, so broadcast and closure are transferred to workers each time. Can we add the idea of python worker reuse to SparkR also, to enhance its performance?
performance issues reference https://issues.apache.org/jira/browse/SPARK-23650