Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-202

Make the request processing in kafka asynchonous

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • None
    • None

    Description

      We need to handle long-lived requests to support replication. To make this work we need to make the processing mechanism asynchronous from the network threads.

      To accomplish this we will retain the existing pool of network threads but add a new pool of request handling threads. These will do all the disk I/O. There will be a queue mechanism to transfer requests to and from this secondary pool.

      Attachments

        1. KAFKA-202-v2.patch
          10 kB
          Jay Kreps
        2. KAFKA-202-v3.patch
          55 kB
          Jay Kreps
        3. KAFKA-202-v4.patch
          64 kB
          Jay Kreps
        4. KAFKA-202-v5.patch
          50 kB
          Jay Kreps
        5. KAFKA-202-v6.patch
          61 kB
          Jay Kreps
        6. KAFKA-48-socket-server-refactor-draft.patch
          44 kB
          Jay Kreps

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-48 Implement optional "long poll" support in fetch request

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              nehanarkhede Neha Narkhede
              jkreps Jay Kreps
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: