Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-58

Use YARN's AMRMClientAsync client library

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.8.0
    • Component/s: yarn
    • Labels:
      None

      Description

      YARN 2.2.0 has a nice Async API for clients and AMs. This API didn't exist when we did the initial YARN integration for Samza. We should upgrade Samza to use these new APIs.

      The API is loosely based off Samza's own AM code, so we can probably strip out a lot of it (YarnAppMaster, mainly), and switch everything over to the call-back based API.

      For details, see:

      https://issues.apache.org/jira/browse/YARN-417

      This new API is used in DistributedShell now, so we can use that for testing.

        Attachments

        1. SAMZA-58.2.patch
          46 kB
          Zhijie Shen
        2. SAMZA-58.1.patch
          43 kB
          Zhijie Shen

          Activity

            People

            • Assignee:
              zjshen Zhijie Shen
              Reporter:
              criccomini Chris Riccomini
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: