Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:

      Description

      Once KAFKA-499 is checked in, every controller to broker communication can be modelled as a state change for one or more partitions. Every state change request will carry the controller epoch. If there is a problem with the state of some partitions, it will be good to have a tool that can create a timeline of requested and completed state changes. This will require each broker to output a state change log that has entries like

      [2012-09-10 10:06:17,280] broker 1 received request LeaderAndIsr() for partition [foo, 0] from controller 2, epoch 1
      [2012-09-10 10:06:17,350] broker 1 completed request LeaderAndIsr() for partition [foo, 0] from controller 2, epoch 1

      On controller, this will look like -

      [2012-09-10 10:06:17,198] controller 2, epoch 1, initiated state change request LeaderAndIsr() for partition [foo, 0]

      We need a tool that can collect the state change log from all brokers and create a per-partition timeline of state changes -

      [foo, 0]

      [2012-09-10 10:06:17,198] controller 2, epoch 1 initiated state change request LeaderAndIsr()
      [2012-09-10 10:06:17,280] broker 1 received request LeaderAndIsr() from controller 2, epoch 1
      [2012-09-10 10:06:17,350] broker 1 completed request LeaderAndIsr() from controller 2, epoch 1

      This JIRA involves adding the state change log to each broker and adding the tool to create the timeline

        Attachments

        1. kafka-513-v5-corrected.patch
          76 kB
          Swapnil Ghike
        2. kafka-513-v5.patch
          76 kB
          Swapnil Ghike
        3. kafka-513-v4.patch
          68 kB
          Swapnil Ghike
        4. kafka-513-v3.patch
          40 kB
          Swapnil Ghike
        5. kafka-513-v2.patch
          37 kB
          Swapnil Ghike
        6. kafka-513-v1.patch
          39 kB
          Swapnil Ghike

          Activity

            People

            • Assignee:
              swapnilghike Swapnil Ghike
              Reporter:
              nehanarkhede Neha Narkhede
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 96h
                96h
                Remaining:
                Remaining Estimate - 96h
                96h
                Logged:
                Time Spent - Not Specified
                Not Specified