[KAFKA-15538] Client support for java regex based subscription

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.8.0
• Component/s: clients, consumer
• Labels: kip-848-client-support newbie regex
• Assignee: Phuc Hong Tran
• Reporter: Lianet Magrans
• Created: 04/Oct/23 16:22
• Updated: 10/Apr/24 17:46
• Resolved: 10/Apr/24 17:46

Description

When using subscribe with a java regex (Pattern), we need to resolve it on the client side to send the broker a list of topic names to subscribe to.

Context:

The new consumer group protocol uses Google RE2/J for regular expressions and introduces new methods in the consumer API to subscribe using a `SubscribePattern`. The subscribe using a java `Pattern` will be still supported for a while but eventually removed.

• When the subscribe with SubscriptionPattern is used, the client should just send the regex to the broker and it will be resolved on the server side.
• In the case of the subscribe with Pattern, the regex should be resolved on the client side.

As part of this task, we should re-enable all integration tests defined in the PlainTextAsyncConsumer that relate to subscription with pattern and that are currently disabled for the new consumer + new protocol

Issue Links

• is part of: KAFKA-14246 Update threading model for Consumer
• relates to: KAFKA-16493 Avoid unneeded subscription regex check if metadata version unchanged
• links to: GitHub Pull Request #15585