[CASSANDRA-10371] Decommissioned nodes can remain in gossip

• Type: Bug
• Status: Resolved
• Priority: Low
• Resolution: Fixed
• Fix Version/s: 2.1.14, 2.2.6, 3.0.4, 3.4
• Component/s: Legacy/Distributed Metadata
• Severity: Low
• Assignee: Joel Knighton
• Reporter: Brandon Williams

Authors

Joel Knighton

Reviewers

Jason Brown

• Created: 18/Sep/15 00:42
• Updated: 16/Apr/19 09:30
• Resolved: 23/Feb/16 22:42

Description

This may apply to other dead states as well. Dead states should be expired after 3 days. In the case of decom we attach a timestamp to let the other nodes know when it should be expired. It has been observed that sometimes a subset of nodes in the cluster never expire the state, and through heap analysis of these nodes it is revealed that the epstate.isAlive check returns true when it should return false, which would allow the state to be evicted. This may have been affected by CASSANDRA-8336.