Uploaded image for project: 'REEF (Retired)'
  1. REEF (Retired)
  2. REEF-51

Add support for .NET Drivers and Tasks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.11
    • REEF, REEF.NET
    • None

    Description

      beysims, juliaw, tmajest and yingdachen have developed a .NET API for REEF to allow applications to mix-and-match JVM and CLR code: The application code in a Driver can be either CLR or Java, while the application can consist of any mixture of CLR and JVM Evaluators.

      This issue is to track our progress in contributing this code to the REEF project. The remainder of this descriptions provides an overview of the work, which consists of several key components, in addition to a complete mirror of the REEF API into a C# class library:

      1. Tang.NET: A complete implementation of Tang for the CLR. By design, it is capable of creating and validating configurations in a cross-language manner. That is: Given a Configuration and ClassHierarchy from C#, Tang/Java can validate whether e.g. a Task can be instantiated. Of course, the same is true with the roles of C# and Java being reversed.
      2. Wake.NET: Wake/Java took great inspiration from the Rx framework in .NET. Wake.NET uses this "happy coincidence" to provide event remoting between Wake/Java and Rx on the CLR. This allows events to originate on the JVM and be processed by a (potentially remote) CLR.
      3. A complete Evaluator implementation in .NET: This provides the runtime for Tasks implemented for .NET without any local overheads: The only thing running in a container is this CLR process, no Java is necessary there.
      4. An event bridge for the Driver: The core of the Driver is Java even when executing event handlers written in .NET. The Java and .NET portions of a Driver co-exist within the same Container (e.g. a YARN Application Master). The bridge performs event and API marshalling between these two worlds.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. REEF-17 Remove DLL in the repository

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. REEF-33 Support pushing Task messages from Evaluator to Driver.

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. REEF-111 Provide continuous integration for the .NET Code

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. REEF-113 Integrate .NET API documentation with our website

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. REEF-114 Trigger .NET build from Maven build

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. REEF-117 Provide build instructions for the .NET code

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue REEF-97 Moving .Net Reef to Apache Git

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. REEF-50 Creating driver config for .Net clients

          • Major - Major loss of function.
          • Closed

          Activity

            People

              beysims Beysim Sezgin
              markus.weimer Markus Weimer
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: