Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:

      Description

      Once KAFKA-499 is checked in, every controller to broker communication can be modelled as a state change for one or more partitions. Every state change request will carry the controller epoch. If there is a problem with the state of some partitions, it will be good to have a tool that can create a timeline of requested and completed state changes. This will require each broker to output a state change log that has entries like

      [2012-09-10 10:06:17,280] broker 1 received request LeaderAndIsr() for partition [foo, 0] from controller 2, epoch 1
      [2012-09-10 10:06:17,350] broker 1 completed request LeaderAndIsr() for partition [foo, 0] from controller 2, epoch 1

      On controller, this will look like -

      [2012-09-10 10:06:17,198] controller 2, epoch 1, initiated state change request LeaderAndIsr() for partition [foo, 0]

      We need a tool that can collect the state change log from all brokers and create a per-partition timeline of state changes -

      [foo, 0]

      [2012-09-10 10:06:17,198] controller 2, epoch 1 initiated state change request LeaderAndIsr()
      [2012-09-10 10:06:17,280] broker 1 received request LeaderAndIsr() from controller 2, epoch 1
      [2012-09-10 10:06:17,350] broker 1 completed request LeaderAndIsr() from controller 2, epoch 1

      This JIRA involves adding the state change log to each broker and adding the tool to create the timeline

      1. kafka-513-v1.patch
        39 kB
        Swapnil Ghike
      2. kafka-513-v2.patch
        37 kB
        Swapnil Ghike
      3. kafka-513-v3.patch
        40 kB
        Swapnil Ghike
      4. kafka-513-v4.patch
        68 kB
        Swapnil Ghike
      5. kafka-513-v5.patch
        76 kB
        Swapnil Ghike
      6. kafka-513-v5-corrected.patch
        76 kB
        Swapnil Ghike

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Swapnil Ghike
            Reporter:
            Neha Narkhede
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 96h
              96h
              Remaining:
              Remaining Estimate - 96h
              96h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development