Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-2332

[AM isolation] YarnJob should pass new command and additional environment variables for AM deployment

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4
    • None
    • None

    Description

      When sending a request to YARN to deploy an application master, some extra environment variables need to be set so that the application master can be run in an isolated mode.

      1. "APPLICATION_MASTER_ISOLATION_ENABLED": if AM isolation is enabled
      2. "APPLICATION_LIB_DIR": location of application lib (e.g. "__package/lib")

      Also, the scripts from the infrastructure resource should be used to launch the job coordinator.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cameronlee Cameron Lee
            cameronlee Cameron Lee
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 50m
                1h 50m

                Issue deployment