[YARN-9837] YARN Service fails to fetch status for Stopped apps with bigger spec files

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.3.0, 3.2.2, 3.1.4
• Component/s: yarn-native-services
• Assignee: Tarun Parimi
• Reporter: Tarun Parimi
• Created: 16/Sep/19 17:16
• Updated: 23/Oct/19 16:14
• Resolved: 17/Sep/19 17:24

Description

Was unable to fetch status for a STOPPED app due to the below error in RM logs.

ERROR webapp.ApiServer (ApiServer.java:getService(213)) - Get service failed: {}
java.io.EOFException: Read of hdfs://my-cluster:8020/user/appuser/.yarn/services/my-service/my-service.json finished prematurely
        at org.apache.hadoop.yarn.service.utils.JsonSerDeser.load(JsonSerDeser.java:188)
        at org.apache.hadoop.yarn.service.utils.ServiceApiUtil.loadService(ServiceApiUtil.java:360)
        at org.apache.hadoop.yarn.service.client.ServiceClient.getAppId(ServiceClient.java:1409)
        at org.apache.hadoop.yarn.service.client.ServiceClient.getStatus(ServiceClient.java:1235)
        at org.apache.hadoop.yarn.service.webapp.ApiServer.lambda$getServiceFromClient$3(ApiServer.java:749)

This seems to happen when the json file my-service.json is larger than 128KB in my cluster.