[IMPALA-3613] Statestore should not update reconnected subscribers repeatedly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.5.0
• Fix Version/s: Impala 2.11.0
• Component/s: Distributed Exec
• Target Version: Product Backlog
• Assignee: Bharath Vissapragada
• Reporter: Huaisi Xu
• Created: 24/May/16 23:22
• Updated: 04/Apr/18 19:04
• Resolved: 15/Nov/17 23:56

Description

Subscriber normally will re-register when it thinks it gets disconnected from statestore in its own perspective. So it will register again. And statestore will push a new update for the newly subscribed clients without cleaning previous already scheduled(queued) one.

If heart beat failed to catch up. those two queues will be filled full and may cause IMPALA-2642 (this can lead to dead lock).

Essentially every new register will have one more update in queue. So we may end up with repeated scheduling for the same subscriber without notice.

Issue Links

• breaks: IMPALA-6785 Starting an Impalad on an already running cluster may result in inconsistent cluster subscription