Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7098

Improve accuracy of the log cleaner throttle rate

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      LogCleaner uses the Throttler class to throttler the log cleaning rate to the user-specified limit, i.e. log.cleaner.io.max.bytes.per.second. However, in Throttler.maybeThrottle(), the periodStartNs is set to the time before the sleep after the sleep() is called, which artificially increase the actual window size and under-estimate the actual log cleaning rate. This causes the log cleaning IO to be higher than the user-specified limit.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hzxa21 Zhanxiang (Patrick) Huang
                Reporter:
                lindong Dong Lin
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: