Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14048

The Next Generation of the Consumer Rebalance Protocol

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Attachments

      Issue Links

        blocks

        Improvement - An improvement or enhancement to an existing feature or task. KAFKA-14524 Modularize `core` monolith

        • Major - Major loss of function.
        • Open
        links to

        Web Link GitHub Pull Request #13203

        Web Link GitHub Pull Request #14090

        Web Link GitHub Pull Request #14327

        mentioned in

        Page Loading...

        1.
        		 Automated protocol should support namespace Sub-task Open David Jacot  
        2.
        		 Add ConsumerGroupPrepareAssignment API Sub-task Open Unassigned  
        3.
        		 Add ConsumerGroupInstallAssignment API Sub-task Open Unassigned  
        4.
        		 Add ConsumerGroupDescribe API Sub-task In Progress Max Riedel  
        5.
        		 Extend DescribeConfigs API to support group configs Sub-task Open Jimmy Wang  
        6.
        		 Extend AlterIncrementalConfigs API to support group config Sub-task In Progress Lan Ding  
        7.
        		 Implement regex subscriptions Sub-task In Progress Phuc Hong Tran  
        8.
        		 OffsetCommit API Version 9 Sub-task Patch Available Alexandre Dupriez  
        9.
        		 OffsetFetch API Version 9 Sub-task In Progress Alexandre Dupriez  
        10.
        		 More broker side partition assignor to common Sub-task Open Unassigned  
        11.
        		 Add ConsumerGroupHeartbeat API to AuthorizerIntegrationTest Sub-task Open Unassigned  
        12.
        		 Add support of topic id for OffsetCommitRequests in CommitRequestManager Sub-task Open Alexandre Dupriez  
        13.
        		 Add ACL Authorizer integration test for authorized OffsetCommits with an unknown topic Sub-task Open Alexandre Dupriez  
        14.
        		 Propagate Topic Ids to the Group Coordinator for Offset Fetch Sub-task Open Alexandre Dupriez  
        15.
        		 Refactor ApiMessageAndVersion/Record Sub-task Open David Jacot  
        16.
        		 Validate that all partitions are assigned in TargetAssignmentBuilder Sub-task Open Unassigned  
        17.
        		 Consolidate all the group coordinator configs Sub-task Open Unassigned  
        18.
        		 Define constants for record types Sub-task Open Unassigned  
        19.
        		 Consider replacing Subscription Metadata by a hash Sub-task Open David Jacot  
        20.
        		 Run System Tests for Old protocol in the New Coordinator Sub-task In Progress Ritika Reddy

        0%
        Original Estimate - 672h
        Remaining Estimate - 672h
        21.
        		 Add histogram metrics to GroupCoordinatorRuntimeMetrics Sub-task Open Unassigned  
        22.
        		 Migrate existing integration tests to run old protocol in new coordinator Sub-task Open Dongnuo Lyu  
        23.
        		 Make General Assignor's rebalance incremental Sub-task Open Unassigned  
        24.
        		 Client support for OffsetFetch and OffsetCommit with topic ID Sub-task Open Lianet Magrans  
        25.
        		 Group commit/callbacks triggering logic Sub-task Open Lianet Magrans  
        26.
        		 Review minimal effort approach on consumer last heartbeat on unsubscribe Sub-task Open Lianet Magrans  
        27.
        		 Review consumer onPartitionsAssigned called with empty partitions Sub-task Open Lianet Magrans  
        28.
        		 Topic ID integration in consumer subscription state Sub-task Open Lianet Magrans  
        29.
        		 Review client logic for triggering offset commit callbacks Sub-task In Progress Lucas Brutschy  
        30.
        		 group size counters do not reflect the actual sizes when operations fail Sub-task Open Jeff Kim  
        31.
        		 Add Integration test for checking if the correct assignor is chosen Sub-task Open Unassigned  
        32.
        		 Move code style exceptions from suppressions.xml to the code Sub-task Open David Jacot  
        33.
        		 Ensure user callbacks exceptions are propagated to the user on consumer poll Sub-task Patch Available Lucas Brutschy  
        34.
        		 Review fenced member unsubscribe/subscribe callbacks interaction Sub-task Open Quoc Phong Dang  
        35.
        		 fix EventAccumulator thread idle ratio metric Sub-task Open Jeff Kim  
        36.
        		 Add event rate in GroupCoordinatorRuntimeMetrics Sub-task Open Jeff Kim  
        37.
        		 add metric to measure time spent in purgatory Sub-task Open Jeff Kim  
        38.
        		 kafka-dump-log --offsets-decoder should support new records Sub-task Open David Jacot  
        39.
        		 getOrMaybeCreateClassicGroup should not thrown GroupIdNotFoundException Sub-task Open Unassigned  
        40.
        		 Online downgrade triggering and group type conversion Sub-task Open Dongnuo Lyu  
        41.
        		 Add JMH Benchmarks for assignor performance testing Sub-task In Progress Ritika Reddy  
        42.
        		 Target Assignment Format Change Sub-task Open Ritika Reddy  
        43.
        		 Store subscription model for consumer group in group state Sub-task Open Ritika Reddy  

        Activity

          People

            dajac David Jacot
            dajac David Jacot
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 672h
                672h
                Remaining:
                Remaining Estimate - 672h
                672h
                Logged:
                Time Spent - Not Specified
                Not Specified