[ATLAS-3054] notification processing to support batch-commits for faster processing of large messages

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0, 2.0.0
• Component/s: atlas-core
• Assignee: Madhan Neethiraj
• Reporter: Madhan Neethiraj
• Created: 21/Feb/19 15:30
• Updated: 26/Sep/19 00:38
• Resolved: 22/Feb/19 00:57

Description

Processing of notifications that create/update large number of entities (say in 1000s) take a significantly longer time to complete, compared to combined time it takes to create/update same number of entities using multiple smaller notifications.

Instead of requiring notification producers to split such a large notification into multiple chunks, Atlas server should be enhanced to perform create/update operations in chunks - for faster processing of such large notifications.