Uploaded image for project: 'REEF (Retired)'
  1. REEF (Retired)
  2. REEF-189 Provide a C# Client to REEF
  3. REEF-227

Add implementation of the REEF Client for HDInsight

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.14
    • REEF.NET
    • None

    Description

      For this implementation, we can go a slightly different route. Both the local and YARN implementations prepare the Driver folder in C# but then hand it over to Java for the actual submission.

      HDInsight offers a REST API for job submission. Hence, we can do the following approach:

      1. C# prepares the Driver folder
      2. Java adds the java side (mostly the Driver configuration)
      3. C# zips it up and submits.

      This would get us one step closer to having a client for machines with no Java installed.

      Attachments

        Issue Links

          contains

          Test - A new unit, integration or system test. REEF-922 Test .NET client REST job submission without Java dependency

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. REEF-910 Assemble entire driver configuration on driver instead of client

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link PR

          Web Link Work is done in this branch.

          Activity

            People

              anupam128 Anupam
              markus.weimer Markus Weimer
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: