[CASSANDRA-13019] Improve clearsnapshot to delete the snapshot files slowly

• Type: Improvement
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 4.0-beta4, 4.0
• Component/s: Legacy/Core
• Labels: pull-request-available
• Impacts: Docs

Source Control Link

https://github.com/apache/cassandra/commit/85f69cf394a8035280a741b117e7dfc71fb848c3

Test and Documentation Plan

Tested manually; unit tests probably needed, too.

• Assignee: Jeff Jirsa
• Reporter: Dikang Gu

Authors

Jeff Jirsa

Reviewers

Aleksey Yeschenko, Chris Lohfink, Jeff Jirsa, Maxwell Guo

• Created: 08/Dec/16 07:00
• Updated: 16/Mar/22 12:41
• Resolved: 09/Nov/20 14:04

Description

In our environment, we are creating snapshots for backup, after we finish the backup, we are running clearsnapshot to delete the snapshot files. At that time we may have thousands of files to delete, and it's causing sudden disk usage spike. As a result, we are experiencing a spike of drop messages from Cassandra.

I think we should implement something like slowrm to delete the snapshot files slowly, avoid the sudden disk usage spike.

Issue Links

• is duplicated by: CASSANDRA-15403 Throttle sstable hardlink creation/removal
• links to: GitHub Pull Request #381