Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4504

Details of retention.bytes property at Topic level are not clear on how they impact partition size

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0.1
    • Fix Version/s: 1.0.0
    • Component/s: documentation
    • Labels:
      None

      Description

      Problem:

      Details of retention.bytes property at Topic level are not clear on how they impact partition size

      Business Impact:

      Users are setting retention.bytes and not seeing the desired store amount of data.

      Current Text:

      This configuration controls the maximum size a log can grow to before we will discard old log segments to free up space if we are using the "delete" retention policy. By default there is no size limit only a time limit.

      Proposed change:

      This configuration controls the maximum size a log can grow to before we will discard old log segments to free up space if we are using the "delete" retention policy. By default there is no size limit only a time limit. Please note, this is calculated as retention.bytes * number of partitions on the given topic for the total amount of disk space to be used.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                omkreddy Manikumar
                Reporter:
                Juma Justin Manchester
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: