Kafka
  1. Kafka
  2. KAFKA-918

Change log.retention.hours to be log.retention.mins

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.2
    • Fix Version/s: 0.8.1
    • Component/s: config
    • Labels:

      Description

      We stood up a cluster that is processing over 350,000 events per second, with each event a fixed payload size of 2K. The storage required to process that much data over an hour is beyond what we wanted to pay for at AWS. Additionally, we don't have a requirement to keep the files around for an extended period after processing.

      It would be tremendously valuable for us to be able to define the log.retention in minutes, not hours. For example, we would prefer to only keep 30 minutes of logs around.

        Activity

        Jason Weiss created issue -
        Jay Kreps made changes -
        Field Original Value New Value
        Labels features features newbie
        Alin Vasile made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Alin Vasile made changes -
        Attachment issue_918.patch [ 12609946 ]
        Alin Vasile made changes -
        Attachment issue_918.patch [ 12610288 ]
        Alin Vasile made changes -
        Attachment issue_918.patch [ 12609946 ]
        Jun Rao made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Assignee Alin Vasile [ avasile ]
        Fix Version/s 0.8.1 [ 12322960 ]
        Resolution Fixed [ 1 ]
        Jun Rao made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Jay Kreps made changes -
        Issue Type New Feature [ 2 ] Improvement [ 4 ]
        Tony Stevenson made changes -
        Workflow no-reopen-closed, patch-avail [ 12783696 ] Apache Kafka Workflow [ 13051116 ]
        Tony Stevenson made changes -
        Workflow Apache Kafka Workflow [ 13051116 ] no-reopen-closed, patch-avail [ 13054537 ]

          People

          • Assignee:
            Alin Vasile
            Reporter:
            Jason Weiss
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development