Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1465

Performance regression for KafkaCheckpointManager

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • None
    • None

    Description

      SAMZA-1427 introduced a performance regression with KafkaCheckpointManager.

      We invoke the checkpoint manager once for each task and the old code would only read the delta for each subsequent call. The SAMZA-1427 code would reread the entire checkpoint topic for each call.

      This effect is even worse when log compaction is not running on the broker.

      Attachments

        Issue Links

          Activity

            People

              jmakes Jake Maes
              jmakes Jake Maes
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: