Kafka
  1. Kafka
  2. KAFKA-138

Bug in the queue timeout logic of the async producer

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7
    • Fix Version/s: 0.7
    • Component/s: core
    • Labels:
      None

      Description

      There is a bug in the queue timeout logic of the async producer. This bug shows up when the producer is very low throughput. The behavior observed by such very low throughput producers is delayed dispatching of the events. There is no observed data loss though.

      1. KAFKA-138.patch
        2 kB
        Neha Narkhede

        Activity

        Jun Rao made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.7 [ 12317243 ]
        Resolution Fixed [ 1 ]
        Hide
        Jun Rao added a comment -

        Thanks, Neha. Just committed this.

        Show
        Jun Rao added a comment - Thanks, Neha. Just committed this.
        Hide
        Jun Rao added a comment -

        +1

        Show
        Jun Rao added a comment - +1
        Neha Narkhede made changes -
        Attachment KAFKA-138.patch [ 12496420 ]
        Neha Narkhede made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Neha Narkhede added a comment -

        This patch corrects the queue.poll logic to respect the queue timeout. Before this, under very low traffic, the producer ended up waiting for a timeout proportional to number of events added to the queue, the upper bound being the batch size.

        Show
        Neha Narkhede added a comment - This patch corrects the queue.poll logic to respect the queue timeout. Before this, under very low traffic, the producer ended up waiting for a timeout proportional to number of events added to the queue, the upper bound being the batch size.
        Neha Narkhede created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Neha Narkhede
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development