[HADOOP-6941] Support non-SUN JREs in UserGroupInformation

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.3, 2.0.0-alpha, 0.23.7

Environment

SLES 11, Apache Harmony 6 and SLES 11, IBM Java 6

• Hadoop Flags: Reviewed
• Assignee: Devaraj Das
• Reporter: Stephen Watt
• Created: 07/Sep/10 22:15
• Updated: 01/Feb/13 12:40
• Resolved: 20/Mar/12 17:20

Description

Attempting to format the namenode or attempting to start Hadoop using Apache Harmony or the IBM Java JREs results in the following exception:

10/09/07 16:35:05 ERROR namenode.NameNode: java.lang.NoClassDefFoundError: com.sun.security.auth.UnixPrincipal
at org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:223)
at java.lang.J9VMInternals.initializeImpl(Native Method)
at java.lang.J9VMInternals.initialize(J9VMInternals.java:200)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.setConfigurationParameters(FSNamesystem.java:420)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:391)
at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1240)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1348)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1368)
Caused by: java.lang.ClassNotFoundException: com.sun.security.auth.UnixPrincipal
at java.net.URLClassLoader.findClass(URLClassLoader.java:421)
at java.lang.ClassLoader.loadClass(ClassLoader.java:652)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:346)
at java.lang.ClassLoader.loadClass(ClassLoader.java:618)
... 8 more

This is a negative regression as previous versions of Hadoop worked with these JREs

Issue Links

• breaks: HADOOP-8251 SecurityUtil.fetchServiceTicket broken after HADOOP-6941
• is related to: ZOOKEEPER-1236 Security uses proprietary Sun APIs
• is related to: HADOOP-7027 Temporary Fix to handle problem in org/apache/hadoop/security/UserGroupInformation.java when using Apache Harmony
• relates to: HADOOP-8192 Fix unit test failures with IBM's JDK
• relates to: HADOOP-6924 Build fails with non-Sun JREs due to different pathing to the operating system architecture shared libraries
• relates to: HADOOP-7211 Security uses proprietary Sun APIs