XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.8.0
    • 0.8.0
    • None

    Description

      Once KAFKA-499 is checked in, every controller to broker communication can be modelled as a state change for one or more partitions. Every state change request will carry the controller epoch. If there is a problem with the state of some partitions, it will be good to have a tool that can create a timeline of requested and completed state changes. This will require each broker to output a state change log that has entries like

      [2012-09-10 10:06:17,280] broker 1 received request LeaderAndIsr() for partition [foo, 0] from controller 2, epoch 1
      [2012-09-10 10:06:17,350] broker 1 completed request LeaderAndIsr() for partition [foo, 0] from controller 2, epoch 1

      On controller, this will look like -

      [2012-09-10 10:06:17,198] controller 2, epoch 1, initiated state change request LeaderAndIsr() for partition [foo, 0]

      We need a tool that can collect the state change log from all brokers and create a per-partition timeline of state changes -

      [foo, 0]

      [2012-09-10 10:06:17,198] controller 2, epoch 1 initiated state change request LeaderAndIsr()
      [2012-09-10 10:06:17,280] broker 1 received request LeaderAndIsr() from controller 2, epoch 1
      [2012-09-10 10:06:17,350] broker 1 completed request LeaderAndIsr() from controller 2, epoch 1

      This JIRA involves adding the state change log to each broker and adding the tool to create the timeline

      Attachments

        1. kafka-513-v1.patch
          39 kB
          Swapnil Ghike
        2. kafka-513-v2.patch
          37 kB
          Swapnil Ghike
        3. kafka-513-v3.patch
          40 kB
          Swapnil Ghike
        4. kafka-513-v4.patch
          68 kB
          Swapnil Ghike
        5. kafka-513-v5.patch
          76 kB
          Swapnil Ghike
        6. kafka-513-v5-corrected.patch
          76 kB
          Swapnil Ghike

        Activity

          People

            swapnilghike Swapnil Ghike
            nehanarkhede Neha Narkhede
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 96h
                96h
                Remaining:
                Remaining Estimate - 96h
                96h
                Logged:
                Time Spent - Not Specified
                Not Specified