[KAFKA-15784] Ensure atomicity of in memory update and write when transactionally committing offsets

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.7.0
• Assignee: Justine Olshan
• Reporter: Justine Olshan
• Created: 03/Nov/23 17:28
• Updated: 14/Dec/23 20:14
• Resolved: 14/Dec/23 19:06

Description

https://github.com/apache/kafka/pull/14370 (KAFKA-15449) removed the locking around validating, updating state, and writing to the log transactional offset commits. (The verification causes us to release the lock)

This was discovered in the discussion of https://github.com/apache/kafka/pull/14629 (KAFKA-15653).

Since KAFKA-15653 is needed for 3.5.1, it makes sense to address the locking issue separately with this ticket. 

Issue Links

• links to: GitHub Pull Request #14774