Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4504

Details of retention.bytes property at Topic level are not clear on how they impact partition size

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.0.1
    • 1.0.0
    • documentation
    • None

    Description

      Problem:

      Details of retention.bytes property at Topic level are not clear on how they impact partition size

      Business Impact:

      Users are setting retention.bytes and not seeing the desired store amount of data.

      Current Text:

      This configuration controls the maximum size a log can grow to before we will discard old log segments to free up space if we are using the "delete" retention policy. By default there is no size limit only a time limit.

      Proposed change:

      This configuration controls the maximum size a log can grow to before we will discard old log segments to free up space if we are using the "delete" retention policy. By default there is no size limit only a time limit. Please note, this is calculated as retention.bytes * number of partitions on the given topic for the total amount of disk space to be used.

      Attachments

        Issue Links

          Activity

            People

              omkreddy Manikumar
              Juma Justin Manchester
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: