[KAFKA-6622] GroupMetadataManager.loadGroupsAndOffsets decompresses record batch needlessly - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.1.0
Component/s: None
Labels:
None

Description

when reading records from a consumer offsets batch, the entire batch is decompressed multiple times (per record) as part of calling `batch.baseOffset`. this is a very expensive operation being called in a loop for no reason:

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

kafka batch iteration funtime.png
08/Mar/18 00:22
230 kB
Radai Rosenblatt

Issue Links

links to

GitHub Pull Request #4661

Activity

People

Assignee:: Radai Rosenblatt

Reporter:: Radai Rosenblatt

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 08/Mar/18 00:23

Updated:: 09/Mar/18 22:26

Resolved:: 09/Mar/18 22:26