[TEZ-3105] TezMxBeanResourceCalculator does not work on IBM JDK 7 or 8 causing Tez failures

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.7.0
• Fix Version/s: 0.7.1, 0.8.3
• Labels: ibm ibm-jdk
• Target Version/s: 0.7.2, 0.8.3
• Assignee: Greg Senia
• Reporter: Greg Senia
• Created: 09/Feb/16 04:57
• Updated: 18/May/16 04:55
• Resolved: 14/Mar/16 18:23

Description

When testing Hive on Tez with IBM JDK 7 and 8. The following issue was discovered:

2016-02-08 22:25:22,869 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at org.apache.hadoop.yarn.util.ResourceCalculatorProcessTree.getResourceCalculatorProcessTree(ResourceCalculatorProcessTree.java:225)
at org.apache.tez.dag.app.DAGAppMaster.initResourceCalculatorPlugins(DAGAppMaster.java:347)
at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:371)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.tez.dag.app.DAGAppMaster$6.run(DAGAppMaster.java:2274)
at java.security.AccessController.doPrivileged(AccessController.java:686)
at javax.security.auth.Subject.doAs(Subject.java:569)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2271)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2086)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:88)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:57)
at java.lang.reflect.Constructor.newInstance(Constructor.java:436)
at org.apache.hadoop.yarn.util.ResourceCalculatorProcessTree.getResourceCalculatorProcessTree(ResourceCalculatorProcessTree.java:221)
... 9 more
Caused by: java.lang.ClassCastException: com.ibm.lang.management.ExtendedOperatingSystem incompatible with com.sun.management.OperatingSystemMXBean
at org.apache.tez.util.TezMxBeanResourceCalculator.<init>(TezMxBeanResourceCalculator.java:44)