Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Now YARN service doesn't allow specifying service name equals to component name.
And it causes AM launch fails with msg like:
org.apache.hadoop.metrics2.MetricsException: Metrics source tf-zeppelin already exists! at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:152) at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:125) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:229) at org.apache.hadoop.yarn.service.ServiceMetrics.register(ServiceMetrics.java:75) at org.apache.hadoop.yarn.service.component.Component.<init>(Component.java:193) at org.apache.hadoop.yarn.service.ServiceScheduler.createAllComponents(ServiceScheduler.java:552) at org.apache.hadoop.yarn.service.ServiceScheduler.buildInstance(ServiceScheduler.java:251) at org.apache.hadoop.yarn.service.ServiceScheduler.serviceInit(ServiceScheduler.java:283) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108) at org.apache.hadoop.yarn.service.ServiceMaster.serviceInit(ServiceMaster.java:142) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164) at org.apache.hadoop.yarn.service.ServiceMaster.main(ServiceMaster.java:338) 2018-06-18 06:50:39,473 [main] INFO service.ServiceScheduler - Stopping service scheduler
It's better to add this check in validation phase instead of failing AM.