Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-182

RM Hostname Specification For SamzaAppMaster

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.7.0
    • Component/s: yarn
    • Labels:
      None

      Description

      When running Samza in a clustered environment, I found that SamzaAppMaster jobs running on remote Yarn NodeManagers do not know how to properly contact the ResourceManager.

      I have included a small patch that adds a directive to the YarnConfig to specify the hostname of the RM via "yarn.rm.hostname". I have tested this directive and it is working in my environment.

      Please take a look at the patch and provide advise on whether this is the correct approach. If there is no better suggestion, i'd be happy to writeup some test cases to support the patch.

        Attachments

        1. SAMZA-182.0.patch
          0.5 kB
          Chris Riccomini
        2. SAMZA-182.1.patch
          0.5 kB
          Chris Riccomini
        3. yarn_remote_rm.patch
          2 kB
          Ethan Setnik

          Activity

            People

            • Assignee:
              criccomini Chris Riccomini
              Reporter:
              esetnik Ethan Setnik
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: