[SAMZA-2593] Update task callback to store only necessary fields instead of the message envelope

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6
• Assignee: Bharath Kumarasubramanian
• Reporter: Bharath Kumarasubramanian
• Created: 23/Sep/20 21:33
• Updated: 26/Oct/20 20:45
• Resolved: 26/Oct/20 20:44

Description

 TaskCallbackImpl currently stores the entire message envelope. In case of jobs that have 1000s of pending callbacks, this adds up to significant memory pressure. The only use for message envelope is to trace the SSP information and the offset associated with it so that we commit the right offset during our commit cycle.

Suggested solution: Modify TaskCallbackImpl to only store SSP and Offset information.