[TEZ-2314] Tez task attempt failures due to bad event serialization

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Fix Version/s: 0.7.0
• Target Version/s: 0.7.0
• Assignee: Bikas Saha
• Reporter: Rohini Palaniswamy
• Created: 13/Apr/15 23:18
• Updated: 30/Jun/15 04:53
• Resolved: 28/Apr/15 05:59

Description

2015-04-13 19:21:48,516 WARN [Socket Reader #3 for port 53530] ipc.Server: Unable to read call parameters for client 10.216.13.112on connection protocol org.apache.tez.common.TezTaskUmbilicalProtocol for rpcKind RPC_WRITABLE
java.lang.ArrayIndexOutOfBoundsException: 1935896432
        at org.apache.tez.runtime.api.impl.EventMetaData.readFields(EventMetaData.java:120)
        at org.apache.tez.runtime.api.impl.TezEvent.readFields(TezEvent.java:271)
        at org.apache.tez.runtime.api.impl.TezHeartbeatRequest.readFields(TezHeartbeatRequest.java:110)
        at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:285)
        at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.readFields(WritableRpcEngine.java:160)
        at org.apache.hadoop.ipc.Server$Connection.processRpcRequest(Server.java:1884)
        at org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1816)
        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1574)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:806)
        at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:673)
        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:644)

cc/ hitesh and bikassaha

Issue Links

• is duplicated by: TEZ-2367 Corruption of TezHeartbeatRequest