[YARN-4965] Distributed shell AM failed due to ClientHandlerException thrown by jersey

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.7.2
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Target Version/s: 2.8.0
• Assignee: Junping Du
• Reporter: Sumana Sathish
• Created: 16/Apr/16 00:05
• Updated: 30/Aug/16 01:03
• Resolved: 17/Apr/16 02:41

Description

Distributed shell AM failed with RuntimeException: ClientHandlerException

app logs

Exception in thread "AMRM Callback Handler Thread" org.apache.hadoop.yarn.exceptions.YarnRuntimeException: com.sun.jersey.api.client.ClientHandlerException: java.io.IOException: Stream closed.
	at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$CallbackHandlerThread.run(AMRMClientAsyncImpl.java:312)
Caused by: com.sun.jersey.api.client.ClientHandlerException: java.io.IOException: Stream closed.
	at com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:563)
	at com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:506)
	at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.putEntities(TimelineClientImpl.java:446)
	at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.publishContainerEndEvent(ApplicationMaster.java:1144)
	at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.access$400(ApplicationMaster.java:169)
	at org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$RMCallbackHandler.onContainersCompleted(ApplicationMaster.java:779)
	at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$CallbackHandlerThread.run(AMRMClientAsyncImpl.java:300)
Caused by: java.io.IOException: Stream closed.
	at java.net.AbstractPlainSocketImpl.available(AbstractPlainSocketImpl.java:458)
	at java.net.SocketInputStream.available(SocketInputStream.java:245)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:342)
	at sun.net.www.http.ChunkedInputStream.readAheadBlocking(ChunkedInputStream.java:552)
	at sun.net.www.http.ChunkedInputStream.readAhead(ChunkedInputStream.java:609)
	at sun.net.www.http.ChunkedInputStream.read(ChunkedInputStream.java:696)
	at java.io.FilterInputStream.read(FilterInputStream.java:133)
	at sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3067)
	at org.codehaus.jackson.impl.ByteSourceBootstrapper.ensureLoaded(ByteSourceBootstrapper.java:507)
	at org.codehaus.jackson.impl.ByteSourceBootstrapper.detectEncoding(ByteSourceBootstrapper.java:129)
	at org.codehaus.jackson.impl.ByteSourceBootstrapper.constructParser(ByteSourceBootstrapper.java:224)
	at org.codehaus.jackson.JsonFactory._createJsonParser(JsonFactory.java:785)
	at org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:561)
	at org.codehaus.jackson.jaxrs.JacksonJsonProvider.readFrom(JacksonJsonProvider.java:414)
	at com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:553)
	... 6 more