[OAK-9936] Optimize AzureJournalWriter#batchWriteLines()

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.44.0
• Fix Version/s: 1.46.0
• Component/s: segment-azure
• Assignee: Miroslav Smiljanic
• Reporter: Carlo Jelmini
• Created: 13/Sep/22 09:26
• Updated: 24/Oct/22 15:01
• Resolved: 24/Oct/22 15:01

Description

The implementation of AzureJournalWriter#batchWriteLines (inside AzureJournalFile) is very inefficient. If the batch size is high, it can take minutes to complete. The issue is that batchWriteLines() simply delegates to writeLine(), which uploads each single line (and metadata) to the blob.

We should implement {{batchWriteLines() }}by uploading multiple lines in one call.

Issue Links

• links to: GitHub Pull Request #704