Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6020

Broker side filtering

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • consumer

    Description

      Currently, it is not possible to filter messages on broker side. Filtering messages on broker side is convenient for filter with very low selectivity (one message in few thousands). In my case it means to transfer several GB of data to consumer, throw it away, take one message and do it again...

      While I understand that filtering by message body is not feasible (for performance reasons), I propose to filter just by message key prefix. This can be achieved even without any deserialization, as the prefix to be matched can be passed as an array (hence the broker would do just array prefix compare).

      Attachments

        Activity

          People

            Unassigned Unassigned
            malejpavouk Pavel Micka
            Votes:
            11 Vote for this issue
            Watchers:
            27 Start watching this issue

            Dates

              Created:
              Updated: