Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8534

retention.bytes does not work as documented

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.11.0.3, 1.0.2, 1.1.1, 2.0.1, 2.1.1, 2.2.1
    • Fix Version/s: None
    • Component/s: log
    • Labels:
      None

      Description

      A log segment isn't deleted when a partition reaches retention.bytes.

      Instead a log segment is deleted when a partition reaches retention.bytes + segment.bytes

      This conflicts with the defenition of retention.bytes:
      This configuration controls the maximum size a partition (which consists of log segments) can grow to before we will discard old log segments to free up space if we are using the "delete" retention policy. By default there is no size limit only a time limit. Since this limit is enforced at the partition level, multiply it by the number of partitions to compute the topic retention in bytes.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              EeveeB Evelyn Bayes
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: