[HADOOP-18143] toString method of RpcCall throws IllegalArgumentException

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Won't Fix
• Labels: pull-request-available
• Assignee: András Győri
• Reporter: András Győri
• Created: 24/Feb/22 16:00
• Updated: 24/Aug/22 10:30
• Resolved: 24/Aug/22 10:30

Description

We have observed breaking tests such as TestApplicationACLs. We have located the root cause, which is HADOOP-18082. It seems that there is a concurrency issue within ProtobufRpcEngine2. When using a debugger, the missing fields are there, hence the suspicion of concurrency problem. The stack trace:

java.lang.IllegalArgumentException
    at java.nio.Buffer.position(Buffer.java:244)
    at org.apache.hadoop.ipc.RpcWritable$ProtobufWrapper.readFrom(RpcWritable.java:131)
    at org.apache.hadoop.ipc.RpcWritable$Buffer.getValue(RpcWritable.java:232)
    at org.apache.hadoop.ipc.ProtobufRpcEngine2$RpcProtobufRequest.getRequestHeader(ProtobufRpcEngine2.java:645)
    at org.apache.hadoop.ipc.ProtobufRpcEngine2$RpcProtobufRequest.toString(ProtobufRpcEngine2.java:663)
    at java.lang.String.valueOf(String.java:3425)
    at java.lang.StringBuilder.append(StringBuilder.java:516)
    at org.apache.hadoop.ipc.Server$RpcCall.toString(Server.java:1328)
    at java.lang.String.valueOf(String.java:3425)
    at java.lang.StringBuilder.append(StringBuilder.java:516)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:3097)

Issue Links

• is broken by: HADOOP-18082 Add debug log when RPC#Reader gets a Call
• is caused by: HADOOP-17046 Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes.
• links to: GitHub Pull Request #4030