[KAFKA-16264] Expose `producer.id.expiration.check.interval.ms` as dynamic broker configuration

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Assignee: Jorge Esteban Quilcate Otoya
• Reporter: Jorge Esteban Quilcate Otoya
• Created: 16/Feb/24 08:19
• Updated: 20/Aug/24 04:27

Description

Dealing with a scenario where too many producer ids lead to issues (e.g. high cpu utilization, see KAFKA-16229) put operators in need to flush producer ids more promptly than usual.

Currently, only the expiration timeout `producer.id.expiration.ms` is exposed as dynamic config. This is helpful (e.g. by reducing the timeout, less producer would eventually be kept in memory), but not enough if the evaluation frequency is not sufficiently short to flush producer ids before becoming an issue. Only by tuning both, the issue could be workaround.

 

Issue Links

• links to: GitHub Pull Request #15888
• mentioned in: Page Loading...