Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2045

Memory Management on the consumer

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • consumer

    Description

      We need to add the memory management on the new consumer like we did in the new producer. This would probably include:

      1. byte buffer re-usage for fetch response partition data.

      2. byte buffer re-usage for on-the-fly de-compression.

      Attachments

        Issue Links

        is related to

        Improvement - An improvement or enhancement to an existing feature or task. KAFKA-1895 Investigate moving deserialization and decompression out of KafkaConsumer

        • Major - Major loss of function.
        • Open
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. KAFKA-4133 Provide a configuration to control consumer max in-flight fetches

        • Major - Major loss of function.
        • Open
        mentioned in

        Page Loading...

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            guozhang Guozhang Wang
            Votes:
            1 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment