[REEF-1355] Adding extensibility to the YarnReefDotNetClient for Multi Runtime

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: REEF
• Assignee: Boris Shulman
• Reporter: Boris Shulman
• Created: 23/Apr/16 16:17
• Updated: 23/Apr/16 21:31

Description

The purpose of this Jira is adding extensibility mechanism to the YarnREEFDotNetClient.
It will allow:
1) Configuring different bootstrap class
2) Plugin in different Param Serialization mechanism. Both Appparameters and Job parameters.
3) Providing additional job driver configuration.

This will allow reusing c# YarRest/HDInsight submission mechanisms for MultiRuntime jobs in those environments.
After the initial work for MultiRunitme C# client will be completed, we will be able to remove the old Bootstrapping mechanism and use the multi runtme mechansim for all Yarn/HDI job submissions.

The main reason for keeping both mechanisms for now is allowing smaller commits while we are working on this feature.