Kafka
  1. Kafka
  2. KAFKA-532

Multiple controllers can co-exist during soft failures

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      If the current controller experiences an intermittent soft failure (GC pause) in the middle of leader election or partition reassignment, a new controller might get elected and start communicating new state change decisions to the brokers. After recovering from the soft failure, the old controller might continue sending some stale state change decisions to the brokers, resulting in unexpected failures. We need to introduce a controller generation id that increments with controller election. The brokers should reject any state change requests by a controller with an older generation id.

      1. kafka-532-v5.patch
        87 kB
        Neha Narkhede
      2. kafka-532-v4.patch
        59 kB
        Neha Narkhede
      3. kafka-532-v3.patch
        51 kB
        Neha Narkhede
      4. kafka-532-v2.patch
        53 kB
        Neha Narkhede
      5. kafka-532-v1.patch
        49 kB
        Neha Narkhede

        Activity

        Neha Narkhede created issue -
        Neha Narkhede made changes -
        Field Original Value New Value
        Assignee Neha Narkhede [ nehanarkhede ]
        Neha Narkhede made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        Neha Narkhede made changes -
        Attachment kafka-532-v1.patch [ 12547011 ]
        Neha Narkhede made changes -
        Status In Progress [ 3 ] Patch Available [ 10002 ]
        Neha Narkhede made changes -
        Attachment kafka-532-v2.patch [ 12547490 ]
        Neha Narkhede made changes -
        Status Patch Available [ 10002 ] In Progress [ 3 ]
        Neha Narkhede made changes -
        Attachment kafka-532-v3.patch [ 12551639 ]
        Neha Narkhede made changes -
        Attachment kafka-532-v4.patch [ 12551891 ]
        Neha Narkhede made changes -
        Attachment kafka-532-v5.patch [ 12553913 ]
        Neha Narkhede made changes -
        Status In Progress [ 3 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Jun Rao made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Neha Narkhede
            Reporter:
            Neha Narkhede
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 48h
              48h
              Remaining:
              Remaining Estimate - 48h
              48h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development