[CASSANDRA-10580] Add latency metrics for dropped messages

• Type: Improvement
• Status: Resolved
• Priority: Low
• Resolution: Fixed
• Fix Version/s: 3.2
• Component/s: Legacy/Coordination, Legacy/Observability

Environment

Production

• Assignee: Anubhav Kale
• Reporter: Anubhav Kale

Authors

Anubhav Kale

Reviewers

Paulo Motta

• Created: 23/Oct/15 16:03
• Updated: 16/Apr/19 09:30
• Resolved: 23/Dec/15 18:17

Description

In our production cluster, we are seeing a large number of dropped mutations. At a minimum, we should print the time the thread took to get scheduled thereby dropping the mutation (We should also print the Message / Mutation so it helps in figuring out which column family was affected). This will help find the right tuning parameter for write_timeout_in_ms.

The change is small and is in StorageProxy.java and MessagingTask.java. I will submit a patch shortly.