[BIGTOP-3718] Fix MapReduce2 service-check in Amabri Mpack

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.2.0
• Component/s: deployment
• Assignee: Yuqi Gu
• Reporter: Yuqi Gu
• Created: 04/Jul/22 08:01
• Updated: 08/Jul/22 09:24
• Resolved: 08/Jul/22 09:24

Description

It failed to check MapReduce2 service when deploying it by Bigtop Mpack in Ambari:

2022-07-01 13:19:25,961 - call returned (0, '')
2022-07-01 13:19:25,961 - get_user_call_output returned (0, u'\{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File does not exist: /user/ambari-qa/mapredsmokeoutput"}}404', u'')
2022-07-01 13:19:25,962 - HdfsResource['/user/ambari-qa/mapredsmokeinput'] \{'security_enabled': False, 'hadoop_bin_dir': '/usr/bin', 'keytab': [EMPTY], 'source': '/etc/passwd', 'dfs_type': 'HDFS', 'default_fs': 'hdfs://bigtop-mpack-slave1-ctos7-x86:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': '/usr/bin/kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'action': ['create_on_execute'], 'hadoop_conf_dir': '/etc/hadoop/conf', 'type': 'file', 'immutable_paths': [u'/mr-history/done', u'/app-logs', u'/tmp']}
2022-07-01 13:19:25,963 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%\{http_code}'"'"' -X GET -d '"'"''"'"' -H '"'"'Content-Length: 0'"'"' '"'"'http://bigtop-mpack-slave1-ctos7-x86:50070/webhdfs/v1/user/ambari-qa/mapredsmokeinput?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpCrcuqS 2>/tmp/tmpY_kPWZ''] \{'logoutput': None, 'quiet': False}
2022-07-01 13:19:26,047 - call returned (0, '')
2022-07-01 13:19:26,047 - get_user_call_output returned (0, u'\{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File does not exist: /user/ambari-qa/mapredsmokeinput"}}404', u'')
2022-07-01 13:19:26,048 - Creating new file /user/ambari-qa/mapredsmokeinput in DFS
2022-07-01 13:19:26,049 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%\{http_code}'"'"' -X PUT --data-binary @/etc/passwd -H '"'"'Content-Type: application/octet-stream'"'"' '"'"'http://bigtop-mpack-slave1-ctos7-x86:50070/webhdfs/v1/user/ambari-qa/mapredsmokeinput?op=CREATE&user.name=hdfs&overwrite=True'"'"' 1>/tmp/tmpenz4Y2 2>/tmp/tmppzNhuA''] \{'logoutput': None, 'quiet': False}

Command failed after 1 tries

 
This task is to refine the Ambari service check python scripts to fix the issues.

And also fix the "JAR does not exist":
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'hadoop --config /etc/hadoop/conf jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.*.jar wordcount /user/ambari-qa/mapredsmokeinput /user/ambari-qa/mapredsmokeoutput' returned 255. JAR does not exist or is not a normal file: /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.*.jar