Kafka
  1. Kafka
  2. KAFKA-532

Multiple controllers can co-exist during soft failures

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      If the current controller experiences an intermittent soft failure (GC pause) in the middle of leader election or partition reassignment, a new controller might get elected and start communicating new state change decisions to the brokers. After recovering from the soft failure, the old controller might continue sending some stale state change decisions to the brokers, resulting in unexpected failures. We need to introduce a controller generation id that increments with controller election. The brokers should reject any state change requests by a controller with an older generation id.

      1. kafka-532-v1.patch
        49 kB
        Neha Narkhede
      2. kafka-532-v2.patch
        53 kB
        Neha Narkhede
      3. kafka-532-v3.patch
        51 kB
        Neha Narkhede
      4. kafka-532-v4.patch
        59 kB
        Neha Narkhede
      5. kafka-532-v5.patch
        87 kB
        Neha Narkhede

        Activity

          People

          • Assignee:
            Neha Narkhede
            Reporter:
            Neha Narkhede
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 48h
              48h
              Remaining:
              Remaining Estimate - 48h
              48h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development