[REEF-1356] Create MultiRuntime Configuration Builder for c#

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: REEF
• Assignee: Boris Shulman
• Reporter: Boris Shulman
• Created: 23/Apr/16 21:40
• Updated: 25/Apr/16 20:11

Description

The purpose of this Jira is creating a mechanism for MultiRuntime Job Submission.

MultiRuntimeConfiguration builder will expose the following interface:

MultiRuntimeConfigurationBuilder
{
        public MultiRuntimeConfigurationBuilder AddRuntime(
                 RuntimeName runtimeName, 
                 IConfiguration configuration = null);

        public MultiRuntimeConfigurationBuilder SetDefaultRuntime(
                  RuntimeName runtimeName);

        public MultiRuntimeConfigurationBuilder SetSubmissionRuntime(
                  SubmissionRuntimeName runtimeName, 
                 IConfiguration configuration);

}

In addition each supported runtime/submission runtime will provide an execution/submission runtime configuration builder. As not each runtime requires additional configuration for execution runtime (Yarn for example), this parameter is optional on the interface.

In order to add additional execution runtime we will need to create a execution runtime builder, add it to the avro schema and alter the bootstrapping code to support it.

Adding new submission runtime is a more complex process as new bootstrap code is required.