[AMBARI-11285] Rolling upgrade: server throws "Work already begun on this thread. Looks like you have called UnitOfWork.begin() twice without a balancing call to end() in between" in Install Packages step

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.0
• Component/s: ambari-server
• Assignee: Di Li
• Reporter: Di Li
• Created: 20/May/15 20:01
• Updated: 26/May/15 15:47
• Resolved: 26/May/15 15:47

Description

I had a 3 node cluster. The ambari server node is also an ambari agent node. The server throws "Work already begun" error after all three agents had finished installing packages. Server always threw the error while dealing with agent heartbeat from the machine where it runs both the agent and the ambari server.

I've got the error after patching my cluster with fixes from JIRA AMBARI-11045.

SEVERE: Could not dispatch event: ActionFinalReportReceivedEvent

{clusterId=2, hostname='bdavm076.svl.ibm.com', commandReportStatus=COMPLETED, commandReportRole=install_packages}

to handler [wrapper public void org.apache.ambari.server.events.listeners.upgrade.DistributeRepositoriesActionListener.onActionFinished(org.apache.ambari.server.events.ActionFinalReportReceivedEvent)]
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.google.common.eventbus.EventHandler.handleEvent(EventHandler.java:74)
at com.google.common.eventbus.SynchronizedEventHandler.handleEvent(SynchronizedEventHandler.java:45)
at com.google.common.eventbus.EventBus.dispatch(EventBus.java:314)
at com.google.common.eventbus.AsyncEventBus.access$001(AsyncEventBus.java:34)
at com.google.common.eventbus.AsyncEventBus$1.run(AsyncEventBus.java:100)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: Work already begun on this thread. Looks like you have called UnitOfWork.begin() twice without a balancing call to end() in between.
at com.google.inject.internal.util.$Preconditions.checkState(Preconditions.java:142)
at com.google.inject.persist.jpa.JpaPersistService.begin(JpaPersistService.java:66)
at com.google.inject.persist.jpa.AmbariJpaPersistService.begin(AmbariJpaPersistService.java:29)
at org.apache.ambari.server.events.listeners.upgrade.DistributeRepositoriesActionListener.onActionFinished(DistributeRepositoriesActionListener.java:96)
... 12 more

Issue Links

• is duplicated by: AMBARI-10818 Hit re-install when performing an RU - UI seems to have stuck at installing even though the request has completed