[KAFKA-7098] Improve accuracy of the log cleaner throttle rate

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Zhanxiang (Patrick) Huang
• Reporter: Dong Lin
• Created: 26/Jun/18 01:51
• Updated: 20/Jul/18 06:51
• Resolved: 20/Jul/18 06:51

Description

LogCleaner uses the Throttler class to throttler the log cleaning rate to the user-specified limit, i.e. log.cleaner.io.max.bytes.per.second. However, in Throttler.maybeThrottle(), the periodStartNs is set to the time before the sleep after the sleep() is called, which artificially increase the actual window size and under-estimate the actual log cleaning rate. This causes the log cleaning IO to be higher than the user-specified limit.

Issue Links

• links to: GitHub Pull Request #5350