Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-927

Integrate controlled shutdown into kafka shutdown hook

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      The controlled shutdown mechanism should be integrated into the software for better operational benefits. Also few optimizations can be done to reduce unnecessary rpc and zk calls. This patch has been tested on a prod like environment by doing rolling bounces continuously for a day. The average time of doing a rolling bounce with controlled shutdown for a cluster with 7 nodes without this patch is 340 seconds. With this patch it reduces to 220 seconds. Also it ensures correctness in scenarios where the controller shrinks the isr and the new leader could place the broker to be shutdown back into the isr.

        Attachments

        1. KAFKA-927.patch
          28 kB
          Sriram
        2. KAFKA-927-v2.patch
          42 kB
          Sriram
        3. KAFKA-927-v2-revised.patch
          60 kB
          Sriram
        4. KAFKA-927-v3.patch
          65 kB
          Sriram
        5. KAFKA-927-v3-removeimports.patch
          65 kB
          Sriram
        6. KAFKA-927-v4.patch
          72 kB
          Sriram

          Activity

            People

            • Assignee:
              sriramsub Sriram
              Reporter:
              sriramsub Sriram
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: