Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.0.1
-
None
Description
When the TSO loses its lease, it panics and invokes the panicker. The default SystemExitPanicker calls System.exit synchronously which, in turn, calls the shutdown hooks synchronously.
This causes the shutdown hooks to run within the Lease management scheduler's lock which is also required to run shutdown.
To replicate the issue:
- start the tso server in HA
- from a ZK shell, update the tso-lease node:
-
- get /omid/tso-lease
- set /omid/tso-lease <the value from get>
- the tso server will panic but fail to shutdown properly
A patch is provided here https://github.com/apache/incubator-omid/pull/52