Uploaded image for project: 'REEF'
  1. REEF
  2. REEF-1776

Use YARN proxy user to register REEF Driver in Unmanaged AM mode

    XMLWordPrintableJSON

    Details

      Description

      When launching REEF application in Unmanaged AM mode from another YARN application, two Drivers access the same global object UserGroupInformation from YARN API. That issue prevents us from running REEF applications on YARN in REEF-on-REEF or REEF-on-Spark settings. We have to implement a mechanism to create proxy YARN users and register Unmanaged AM Drivers in that proxy user context and update the API so that REEF client can pass the user credentials into the driver setup.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                motus Sergiy Matusevych
                Reporter:
                motus Sergiy Matusevych
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 168h
                  168h
                  Remaining:
                  Remaining Estimate - 168h
                  168h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified