[SAMZA-58] Use YARN's AMRMClientAsync client library

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.6.0
• Fix Version/s: 0.8.0
• Component/s: yarn
• Assignee: Zhijie Shen
• Reporter: Chris Riccomini
• Created: 21/Oct/13 16:31
• Updated: 17/Apr/14 08:01
• Resolved: 07/Apr/14 15:38

Description

YARN 2.2.0 has a nice Async API for clients and AMs. This API didn't exist when we did the initial YARN integration for Samza. We should upgrade Samza to use these new APIs.

The API is loosely based off Samza's own AM code, so we can probably strip out a lot of it (YarnAppMaster, mainly), and switch everything over to the call-back based API.

For details, see:

https://issues.apache.org/jira/browse/YARN-417

This new API is used in DistributedShell now, so we can use that for testing.