Bulk Operation

MAPREDUCE-3561 MapReduce job submission time has increased in 0.23 when compared to 0.20.206

MAPREDUCE-3561 RM scalability runtime is worse than 0.20.204 by 14.2%

MAPREDUCE-3561 Counters aggregation slowed down significantly after MAPREDUCE-3749

MAPREDUCE-3561 Counters are getting calculated twice at job-finish and delaying clients.

MAPREDUCE-3561 Data Locality suffers if the AM asks for containers using IPs instead of hostnames

MAPREDUCE-3561 RackResolver should maintain a cache to avoid repetitive lookups.

MAPREDUCE-3561 Lower default allocation sizes, fix allocation configurations and document them

MAPREDUCE-3561 MR AM's ContainerAllocator is assigning the allocated containers very slowly

MAPREDUCE-3561 Tasks may take upto 3 seconds to exit after completion

MAPREDUCE-3561 Make gridmix performance on YARN+MR to match or exceed that on 1.0

MAPREDUCE-3561 Default AM heartbeat interval should be one second

MAPREDUCE-3561 AM-NM RPC calls occasionally takes a long time to respond

MAPREDUCE-3561 CapacityScheduler should be more conservative assigning off-switch requests

MAPREDUCE-3561 DFSIO read throughput is decreased by 16% in 0.23.1 than Hadoop-0.20.204 on 350 nodes size cluster.

MAPREDUCE-3561 TaskHeartbeatHandler holds a global lock for all task-updates

MAPREDUCE-3561 Thread pool for launching containers in MR AM not expanding as expected

MAPREDUCE-3561 MR AM's dispatcher is blocked by heartbeats to ResourceManager

MAPREDUCE-3561 TaskAttemptListener holds a global lock for all task-updates

MAPREDUCE-3561 Optimize Job's progress calculations in MR AM

MAPREDUCE-3561 Extraneous JobConf objects in AM heap

MAPREDUCE-3561 MR AM slows down due to repeatedly constructing ContainerLaunchContext

MAPREDUCE-3561 Compression benchmark run-time increased by 13% in 0.23

MAPREDUCE-3561 Shuffle benchmark is nearly 1.5x slower in 0.23

MAPREDUCE-3561 Scan benchmark is more than 1.5x slower in 0.23

MAPREDUCE-3561 Batch jobHistory disk flushes

MAPREDUCE-3561 Counters occupy a good part of AM heap

MAPREDUCE-3561 Optimize YARN API calls

MAPREDUCE-3561 AMScalability test of Sleep job with 100K 1-sec maps regressed into running very slowly

MAPREDUCE-3561 ContainerLocalizer should request new resources after completing the current one