[MAPREDUCE-6922] MapReduce jobs may fail during rolling upgrade due to MAPREDUCE-6829

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Duplicate
• Target Version/s: 2.9.0
• Assignee: Miklos Szegedi
• Reporter: Miklos Szegedi
• Created: 31/Jul/17 21:19
• Updated: 10/Oct/17 02:32
• Resolved: 31/Jul/17 21:50

Description

MAPREDUCE-6829 should be reverted from branch-2 because rolling upgrade fails.

2017-06-08 17:43:37,173 WARN [Socket Reader #1 for port 41187] org.apache.hadoop.ipc.Server: Unable to read call parameters for client 10.17.242.22on connection protocol org.apache.hadoop.mapred.TaskUmbilicalProtocol for rpcKind RPC_WRITABLE
java.lang.ArrayIndexOutOfBoundsException: 23
	at org.apache.hadoop.mapreduce.counters.FrameworkCounterGroup.readFields(FrameworkCounterGroup.java:261)
	at org.apache.hadoop.mapred.Counters$Group.readFields(Counters.java:324)
	at org.apache.hadoop.mapreduce.counters.AbstractCounters.readFields(AbstractCounters.java:306)
	at org.apache.hadoop.mapred.TaskStatus.readFields(TaskStatus.java:489)
	at org.apache.hadoop.mapred.MapTaskStatus.readFields(MapTaskStatus.java:88)
	at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:285)
	at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.readFields(WritableRpcEngine.java:160)
	at org.apache.hadoop.ipc.Server$Connection.processRpcRequest(Server.java:1909)
	at org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1841)
	at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1600)
	at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:820)
	at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:693)
	at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:664)

Issue Links

• duplicates: MAPREDUCE-6829 Add peak memory usage counter for each task
• is duplicated by: MAPREDUCE-6978 MR task counters deserialized through RPC throws OutOfBoundsException if Counter enum class version not match