Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-182

RM Hostname Specification For SamzaAppMaster

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.7.0
    • yarn
    • None

    Description

      When running Samza in a clustered environment, I found that SamzaAppMaster jobs running on remote Yarn NodeManagers do not know how to properly contact the ResourceManager.

      I have included a small patch that adds a directive to the YarnConfig to specify the hostname of the RM via "yarn.rm.hostname". I have tested this directive and it is working in my environment.

      Please take a look at the patch and provide advise on whether this is the correct approach. If there is no better suggestion, i'd be happy to writeup some test cases to support the patch.

      Attachments

        1. SAMZA-182.1.patch
          0.5 kB
          Chris Riccomini
        2. SAMZA-182.0.patch
          0.5 kB
          Chris Riccomini
        3. yarn_remote_rm.patch
          2 kB
          Ethan Setnik

        Activity

          People

            criccomini Chris Riccomini
            esetnik Ethan Setnik
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: