[AMBARI-24503] LLAP application on Yarn fails with CNF exception on sysprepped cluster.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.1
• Fix Version/s: 2.7.1
• Labels: pull-request-available
• Assignee: Aravindan Vijayan
• Reporter: Aravindan Vijayan
• Created: 18/Aug/18 05:39
• Updated: 20/Aug/18 20:12
• Resolved: 20/Aug/18 19:19

Description

LLAP Yarn application failed to start due to missing azure class.

18/08/15 20:08:28 INFO service.ServiceMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 4 cluster_timestamp: 1534200616336 } attemptId: 3 } keyId: 1688030095)
18/08/15 20:08:28 INFO service.AbstractService: Service Service Master failed in state INITED
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2596)
	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3320)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3352)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
	at org.apache.hadoop.yarn.service.utils.CoreFileSystem.<init>(CoreFileSystem.java:73)
	at org.apache.hadoop.yarn.service.utils.SliderFileSystem.<init>(SliderFileSystem.java:41)
	at org.apache.hadoop.yarn.service.ServiceMaster.serviceInit(ServiceMaster.java:100)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.yarn.service.ServiceMaster.main(ServiceMaster.java:338)
Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2500)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2594)
... 12 more

 18/08/15 20:08:28 INFO service.ServiceMaster: Stopping app master
18/08/15 20:08:28 ERROR service.ServiceMaster: Error starting service master
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2596)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3320)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3352)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at org.apache.hadoop.yarn.service.utils.CoreFileSystem.<init>(CoreFileSystem.java:73)
at org.apache.hadoop.yarn.service.utils.SliderFileSystem.<init>(SliderFileSystem.java:41)
at org.apache.hadoop.yarn.service.ServiceMaster.serviceInit(ServiceMaster.java:100)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
at org.apache.hadoop.yarn.service.ServiceMaster.main(ServiceMaster.java:338)
Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2500)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2594)
... 12 more

Issue Links

• links to: GitHub Pull Request #2114
• links to: GitHub Pull Request #2118