Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-532

Multiple controllers can co-exist during soft failures

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      If the current controller experiences an intermittent soft failure (GC pause) in the middle of leader election or partition reassignment, a new controller might get elected and start communicating new state change decisions to the brokers. After recovering from the soft failure, the old controller might continue sending some stale state change decisions to the brokers, resulting in unexpected failures. We need to introduce a controller generation id that increments with controller election. The brokers should reject any state change requests by a controller with an older generation id.

        Attachments

        1. kafka-532-v5.patch
          87 kB
          Neha Narkhede
        2. kafka-532-v4.patch
          59 kB
          Neha Narkhede
        3. kafka-532-v3.patch
          51 kB
          Neha Narkhede
        4. kafka-532-v2.patch
          53 kB
          Neha Narkhede
        5. kafka-532-v1.patch
          49 kB
          Neha Narkhede

          Activity

            People

            • Assignee:
              nehanarkhede Neha Narkhede
              Reporter:
              nehanarkhede Neha Narkhede
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified