[YARN-1024] Define a CPU resource(s) unambigiously

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Arun Murthy
• Reporter: Arun Murthy
• Created: 04/Aug/13 18:48
• Updated: 01/Oct/13 02:42

Description

We need to clearly define the meaning of a virtual core unambiguously so that it's easy to migrate applications between clusters.

For e.g. here is Amazon EC2 definition of ECU: http://aws.amazon.com/ec2/faqs/#What_is_an_EC2_Compute_Unit_and_why_did_you_introduce_it

Essentially we need to clearly define a YARN Virtual Core (YVC).

Equivalently, we can use ECU itself: One EC2 Compute Unit provides the equivalent CPU capacity of a 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor.

Issue Links

• is blocked by: YARN-160 nodemanagers should obtain cpu/memory values from underlying OS
• relates to: YARN-160 nodemanagers should obtain cpu/memory values from underlying OS
• relates to: YARN-972 Allow requests and scheduling for fractional virtual cores

Sub-Tasks

• Add YARN compute units alongside virtual cores: Open
• Document the meaning of a virtual core: Closed