[BOOKKEEPER-69] ServerRedirectLoopException when a machine (hosts bookie server & hub server) reboot, which is caused by race condition of topic manager

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: hedwig-client, hedwig-server

Environment

3 machines (perf8, perf9, perf10), each machine hosts a bookie server & a hub server.
perf8 is used as default server for client 1. perf9 is used as default server for client 2.

bookkeeper is configured as below:
ensemble size is 3, quorum size is 2.

• Assignee: Ivan Kelly
• Reporter: Sijie Guo
• Created: 28/Sep/11 06:01
• Updated: 07/Dec/11 15:56
• Resolved: 18/Nov/11 10:39

Description

1) machine perf10 is rebooted. the bookie server & hub server are not restarted automatically after reboot.
2) client 1 & client 2 are still running. the topics owned in perf10 will be re-assigned to perf8/perf9. but they would fail because not enough bookie servers are available.
3) after 2 hours, we found that perf10 is rebooted. we restarted bookie server & hub server on perf10
4) then we got ServerRedirectLoopException in client.