[REEF-1828] An Extension that Allows Users to Provide Start Scripts for an Evaluator

• Type: Wish
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.15
• Component/s: REEF Evaluator
• Assignee: Unassigned
• Reporter: Shouheng Yi
• Created: 13/Jul/17 17:00
• Updated: 19/Jul/17 14:35

Description

I've been working with REEF on a cluster for a recent project. One of the common themes I observed is that I have to configure the machines which REEF evaluators reside on, for example, opening ports, modifying firewall rules, etc.

I couldn't easily find a place to do so in REEF. Therefore the only option I'm aware of is to modify REEF's source code and embed a custom process to run the scripts. This practice is neither safe nor proper.

My argument for this extension is that users will have different needs and settings on their clusters - which is something that we couldn't predict. It will be nice if we offer users some freedom to plug in some customized scripts for them to set up the cluster according to their needs, of course, in a safe fashion managed by REEF.

I'm wondering if we are open to this idea. Thanks.