Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-202

Make the request processing in kafka asynchonous

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      We need to handle long-lived requests to support replication. To make this work we need to make the processing mechanism asynchronous from the network threads.

      To accomplish this we will retain the existing pool of network threads but add a new pool of request handling threads. These will do all the disk I/O. There will be a queue mechanism to transfer requests to and from this secondary pool.

        Attachments

        1. KAFKA-48-socket-server-refactor-draft.patch
          44 kB
          Jay Kreps
        2. KAFKA-202-v2.patch
          10 kB
          Jay Kreps
        3. KAFKA-202-v3.patch
          55 kB
          Jay Kreps
        4. KAFKA-202-v4.patch
          64 kB
          Jay Kreps
        5. KAFKA-202-v5.patch
          50 kB
          Jay Kreps
        6. KAFKA-202-v6.patch
          61 kB
          Jay Kreps

          Issue Links

            Activity

              People

              • Assignee:
                nehanarkhede Neha Narkhede
                Reporter:
                jkreps Jay Kreps
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: