[CASSANDRA-18512] nodetool describecluster command is not showing correct Down count.

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 4.0.11, 4.1.3, 5.0-alpha1, 5.0
• Component/s: Tool/nodetool
• Bug Category: Correctness - Transient Incorrect Response
• Severity: Low
• Complexity: Low Hanging Fruit
• Discovered By: User Report
• Platform: All
• Since Version: 4.0.0

Source Control Link

https://github.com/apache/cassandra/commit/5655a33bc0fe53db940471fc1cb5972f13cda0de

Test and Documentation Plan

run CI

• Assignee: Ranju
• Reporter: Ranju

Authors

Ranju

Reviewers

Brandon Williams, Stefan Miklosovic

• Created: 10/May/23 05:27
• Updated: 12/Sep/23 13:03
• Resolved: 05/Jun/23 14:07

Description

There are some nodes down in the cluster of Cassandra Version 4.x

1. nodetool describecluster command output shows these ips as unreachable.

UNREACHABLE: [<ip1>, <ip2>, <ip3>]

Stats for all nodes:
        Live: 3
        Joining: 0
        Moving: 0
        Leaving: 0
        Unreachable: 3

But under data center , count of down pod is always shown as 0.

Data Centers: 
    dc1 #Nodes: 3 #Down: 0
    dc2 #Nodes: 3 #Down: 0

 

Steps to reproduce:

1. Setup two Data centers dc1,dc2, each datacenter was having 3 nodes - dc1:3,dc2:3
2. mark down any 3 nodes of two data centers.
3. Run nodetool describecluster command from the live node and check the Unreachable count , which is 3 and Down Count is 0 , both are not matched.

 

Expected Output: Unreachable and Down count should have the same value.

Data Centers:
        dc1 #Nodes: 3 #Down: 1

        dc2 #Nodes: 3 #Down: 2