[MAPREDUCE-3524] Scan benchmark is more than 1.5x slower in 0.23

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.1
• Component/s: benchmarks, mr-am, mrv2, performance
• Assignee: Unassigned
• Reporter: Karam Singh
• Created: 09/Dec/11 11:03
• Updated: 21/Feb/12 23:10
• Resolved: 21/Feb/12 23:10

Description

Scan benchmark is more than 1.5X slower(almost 92% increased) in 0.23 than Hadoop-0.20.204 on 350 nodes size cluster.

Issue Links

• is blocked by: MAPREDUCE-3809 Tasks may take upto 3 seconds to exit after completion
• is blocked by: MAPREDUCE-3810 MR AM's ContainerAllocator is assigning the allocated containers very slowly
• is blocked by: MAPREDUCE-3827 Counters aggregation slowed down significantly after MAPREDUCE-3749
• is blocked by: MAPREDUCE-3815 Data Locality suffers if the AM asks for containers using IPs instead of hostnames
• is blocked by: MAPREDUCE-3813 RackResolver should maintain a cache to avoid repetitive lookups.
• is blocked by: MAPREDUCE-3823 Counters are getting calculated twice at job-finish and delaying clients.
• is blocked by: MAPREDUCE-3808 NPE in FileOutputCommitter when running a 0 reduce job
• relates to: MAPREDUCE-3710 last split generated by FileInputFormat.getSplits may not have the best locality