[YARN-386] [Umbrella] YARN API Changes

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Target Version/s: 2.1.0-beta
• Assignee: Vinod Kumar Vavilapalli
• Reporter: Vinod Kumar Vavilapalli
• Created: 07/Feb/13 04:59
• Updated: 09/Oct/13 19:20

Description

This is the umbrella ticket to capture any and every API cleanup that we wish to do before YARN can be deemed beta/stable. Doing this API cleanup now and ASAP will help us escape the pain of supporting bad APIs in beta/stable releases.

Issue Links

• is blocked by: YARN-85 Allow per job log aggregation configuration
• is blocked by: YARN-352 Inconsistent picture of how a container was killed when querying RM and NM in case of preemption
• is blocked by: YARN-221 NM should provide a way for AM to tell it not to aggregate logs.
• is blocked by: YARN-1279 Expose a client API to allow clients to figure if log aggregation is complete
• is blocked by: YARN-475 Remove ApplicationConstants.AM_APP_ATTEMPT_ID_ENV as it is no longer set in an AM's environment
• is blocked by: YARN-550 ContainerLaunchContext::getServiceData and setServiceData need a lot of clarification
• is blocked by: YARN-662 [Umbrella] Enforce required parameters for all the protocols
• relates to: YARN-435 Make it easier to access cluster topology information in an AM
• relates to: YARN-723 Yarn default value of physical cpu cores to virtual core is 2
• relates to: YARN-142 [Umbrella] Cleanup YARN APIs w.r.t exceptions

Sub-Tasks

• Improve documentation about what "asks" means in AMRMProtocol: Open
• RM should throw different exceptions for while querying app/node/queue: Open
• Make it easier to access cluster topology information in an AM: Open
• Expose resource metrics as part of YarnClusterMetrics: Open
• Make all YARN API and libraries available through an api jar: Open
• Cleanup BuilderUtils: Open
• AMRMClient should have a separate setProgress instead of sending progress as part of allocate: Open
• Investigate adding a more generic error field to AMResponse: Open
• YARN application classpath should add $PWD/* in addition to $PWD: Open
• Consider adding clone methods to protocol objects: Open
• yarn.application.classpath requires client to know service internals: Open
• ApplicationReport can return tokens only when users asks for it explicitly: Open
• ApplicationContants should be a proto definition instead of being a java class: Open
• FinishApplicationMasterRequest should also have a final IPC/RPC address.: Open