[MYRIAD-170] Myriad initialization fails with "parameter 5 of org.apache.myriad.scheduler.MyriadOperations.<init>() is not @Nullable"

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Myriad 0.2.0
• Fix Version/s: Myriad 0.1.0
• Component/s: Scheduler
• Environment: CentOS7
• Assignee: Swapnil Daingade
• Reporter: Chong Yeol Nah
• Created: 06/Nov/15 03:01
• Updated: 09/Nov/15 02:55
• Resolved: 09/Nov/15 02:55

Description

After the framework gets registered, scheduler initialization complains that " null returned by binding at org.apache.myriad.MyriadModule.providesMyriadStateStore()"

I have build Myriad according to the remote binary distribution document.
Additional steps I did out of the document was setting up the http_proxy environment value.

I've search if this problem was brought up before but failed to find answers.

Below is the log output of the scheduler.

==============================

I1106 10:42:01.039393 11243 sched.cpp:641] Framework registered with c70248ae-62a9-4a02-82b9-46a5e10fd15f-0016
15/11/06 10:42:01 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler failed in state STARTED; cause: java.lang.RuntimeException: Failed to initialize myriad
java.lang.RuntimeException: Failed to initialize myriad
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:52)
at org.apache.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:92)
at org.apache.myriad.scheduler.yarn.MyriadFairScheduler.serviceStart(MyriadFairScheduler.java:75)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:503)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:898)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:938)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:935)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:935)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:979)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1104)
Caused by: com.google.inject.ProvisionException: Guice provision errors:

1) null returned by binding at org.apache.myriad.MyriadModule.providesMyriadStateStore()
but parameter 5 of org.apache.myriad.scheduler.MyriadOperations.<init>() is not @Nullable
at org.apache.myriad.MyriadModule.providesMyriadStateStore(MyriadModule.java:154)
while locating org.apache.myriad.state.MyriadStateStore
for parameter 5 at org.apache.myriad.scheduler.MyriadOperations.<init>(MyriadOperations.java:59)
while locating org.apache.myriad.scheduler.MyriadOperations

1 error
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:987)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.myriad.Main.startNMInstances(Main.java:202)
at org.apache.myriad.Main.run(Main.java:113)
at org.apache.myriad.Main.initialize(Main.java:88)
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:49)
... 16 more
15/11/06 10:42:01 INFO service.AbstractService: Service RMActiveServices failed in state STARTED; cause: java.lang.RuntimeException: Failed to initialize myriad
java.lang.RuntimeException: Failed to initialize myriad
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:52)
at org.apache.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:92)
at org.apache.myriad.scheduler.yarn.MyriadFairScheduler.serviceStart(MyriadFairScheduler.java:75)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:503)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:898)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:938)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:935)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:935)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:979)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1104)
Caused by: com.google.inject.ProvisionException: Guice provision errors:

1) null returned by binding at org.apache.myriad.MyriadModule.providesMyriadStateStore()
but parameter 5 of org.apache.myriad.scheduler.MyriadOperations.<init>() is not @Nullable
at org.apache.myriad.MyriadModule.providesMyriadStateStore(MyriadModule.java:154)
while locating org.apache.myriad.state.MyriadStateStore
for parameter 5 at org.apache.myriad.scheduler.MyriadOperations.<init>(MyriadOperations.java:59)
while locating org.apache.myriad.scheduler.MyriadOperations

1 error
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:987)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.myriad.Main.startNMInstances(Main.java:202)
at org.apache.myriad.Main.run(Main.java:113)
at org.apache.myriad.Main.initialize(Main.java:88)
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:49)
... 16 more
15/11/06 10:42:01 INFO impl.MetricsSystemImpl: Stopping ResourceManager metrics system...
15/11/06 10:42:01 INFO impl.MetricsSystemImpl: ResourceManager metrics system stopped.
15/11/06 10:42:01 INFO impl.MetricsSystemImpl: ResourceManager metrics system shutdown complete.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO event.AsyncDispatcher: AsyncDispatcher is draining to stop, igonring any new events.
15/11/06 10:42:01 INFO util.AbstractLivelinessMonitor: AMLivelinessMonitor thread interrupted
15/11/06 10:42:01 INFO util.AbstractLivelinessMonitor: AMLivelinessMonitor thread interrupted
15/11/06 10:42:01 INFO util.AbstractLivelinessMonitor: org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer thread interrupted
15/11/06 10:42:01 ERROR delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
15/11/06 10:42:01 INFO service.AbstractService: Service ResourceManager failed in state STARTED; cause: java.lang.RuntimeException: Failed to initialize myriad
java.lang.RuntimeException: Failed to initialize myriad
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:52)
at org.apache.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:92)
at org.apache.myriad.scheduler.yarn.MyriadFairScheduler.serviceStart(MyriadFairScheduler.java:75)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:503)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:898)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:938)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:935)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:935)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:979)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1104)
Caused by: com.google.inject.ProvisionException: Guice provision errors:

1) null returned by binding at org.apache.myriad.MyriadModule.providesMyriadStateStore()
but parameter 5 of org.apache.myriad.scheduler.MyriadOperations.<init>() is not @Nullable
at org.apache.myriad.MyriadModule.providesMyriadStateStore(MyriadModule.java:154)
while locating org.apache.myriad.state.MyriadStateStore
for parameter 5 at org.apache.myriad.scheduler.MyriadOperations.<init>(MyriadOperations.java:59)
while locating org.apache.myriad.scheduler.MyriadOperations

1 error
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:987)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.myriad.Main.startNMInstances(Main.java:202)
at org.apache.myriad.Main.run(Main.java:113)
at org.apache.myriad.Main.initialize(Main.java:88)
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:49)
... 16 more
15/11/06 10:42:01 INFO resourcemanager.ResourceManager: Transitioning to standby state
15/11/06 10:42:01 INFO resourcemanager.ResourceManager: Transitioned to standby state
15/11/06 10:42:01 FATAL resourcemanager.ResourceManager: Error starting ResourceManager
java.lang.RuntimeException: Failed to initialize myriad
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:52)
at org.apache.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:92)
at org.apache.myriad.scheduler.yarn.MyriadFairScheduler.serviceStart(MyriadFairScheduler.java:75)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:503)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:898)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:938)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:935)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:935)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:979)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1104)
Caused by: com.google.inject.ProvisionException: Guice provision errors:

1) null returned by binding at org.apache.myriad.MyriadModule.providesMyriadStateStore()
but parameter 5 of org.apache.myriad.scheduler.MyriadOperations.<init>() is not @Nullable
at org.apache.myriad.MyriadModule.providesMyriadStateStore(MyriadModule.java:154)
while locating org.apache.myriad.state.MyriadStateStore
for parameter 5 at org.apache.myriad.scheduler.MyriadOperations.<init>(MyriadOperations.java:59)
while locating org.apache.myriad.scheduler.MyriadOperations

1 error
at com.google.inject.internal.InjectorImpl$4.get(InjectorImpl.java:987)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.myriad.Main.startNMInstances(Main.java:202)
at org.apache.myriad.Main.run(Main.java:113)
at org.apache.myriad.Main.initialize(Main.java:88)
at org.apache.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:49)
... 16 more
15/11/06 10:42:01 INFO resourcemanager.ResourceManager: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at ms03/172.16.110.23
************************************************************/