[MAPREDUCE-2424] MR-279: counters/UI/etc. for uber-AppMaster (in-cluster LocalJobRunner for MRv2)

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.23.0
• Component/s: mrv2
• Hadoop Flags: Reviewed
• Assignee: Greg Roelofs
• Reporter: Greg Roelofs
• Created: 08/Apr/11 03:18
• Updated: 15/Nov/11 00:48
• Resolved: 15/Apr/11 20:40

Description

Polish uber-AM (MAPREDUCE-2405). Specifically:

• uber-specific counters ("command-line UI")
• GUI indicators
  • RM all-containers level
  • multi-job app level [if exists]
  • single-job level
• fix uber-decision ("is this a small job?"):
  • memory criterion
  • input-bytes criterion
• disable speculation
• isUber() method (somewhere) for unit tests to use
• delete (most of) old UberTask code (MAPREDUCE-1220; came in with initial MR-279 branch)
• implement non-RPC, local version of umbilical
• AM restart (default 4 tries) on another node on any task-attempt failure
• uber-specific metrics?
• rename configurables? (still "ubertask"-based)

Issue Links

• is a clone of: MAPREDUCE-2405 MR-279: Implement uber-AppMaster (in-cluster LocalJobRunner for MRv2)