[MAPREDUCE-2855] ResourceBundle lookup during counter name resolution takes a lot of time

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.2
• Labels: mrv2
• Target Version/s: 0.23.2
• Hadoop Flags: Reviewed
• Release Note: Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time.
• Assignee: Siddharth Seth
• Reporter: Todd Lipcon
• Created: 18/Aug/11 17:04
• Updated: 18/Aug/12 19:22
• Resolved: 28/Feb/12 02:02

Description

Loading a job status page in trunk takes a lot of time, and it seems like most of the time is spent resolving counter names. Looking through the JDK source, ResourceBundle.getBundle(String) ends up calling getClassContext() which is not very efficient. I think if we pass our own classloader manually it will be faster. In Counters.incrAllCounters, we may also be able to avoid setting the counter name if one is already set.

Issue Links

• is cloned by: MAPREDUCE-4565 Backport MR-2855 to branch-1: ResourceBundle lookup during counter name resolution takes a lot of time