Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-58

Use YARN's AMRMClientAsync client library

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.6.0
    • 0.8.0
    • yarn
    • None

    Description

      YARN 2.2.0 has a nice Async API for clients and AMs. This API didn't exist when we did the initial YARN integration for Samza. We should upgrade Samza to use these new APIs.

      The API is loosely based off Samza's own AM code, so we can probably strip out a lot of it (YarnAppMaster, mainly), and switch everything over to the call-back based API.

      For details, see:

      https://issues.apache.org/jira/browse/YARN-417

      This new API is used in DistributedShell now, so we can use that for testing.

      Attachments

        1. SAMZA-58.2.patch
          46 kB
          Zhijie Shen
        2. SAMZA-58.1.patch
          43 kB
          Zhijie Shen

        Activity

          People

            zjshen Zhijie Shen
            criccomini Chris Riccomini
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: