Uploaded image for project: 'REEF (Retired)'
  1. REEF (Retired)
  2. REEF-766

The java side of the YARN client does not merge the Configurations provided by the DriverConfigurationProviders

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.13
    • REEF.NET Client
    • None

    Description

      The .NET client currently invokes a Java program to do the actual submission. In the case of YARN, that is YarnJobSubmissionClient. However, that class does not merge the configurations provided by the DriverConfigurationProviders. This means that, for instance, configured port ranges are not handed over from C# to Java.

      Note that the issue doesn't exist for the local client, LocalClient. Its submit method merges the configurations in. We should do the same in YarnJobSubmissionClient

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. REEF-765 Make job submission from C# through the java client safer

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link Link to PR

          Activity

            People

              juliaw Julia Wang
              markus.weimer Markus Weimer
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: