[BOOKKEEPER-757] Ledger Recovery Improvement

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.5.0
• Component/s: bookkeeper-client
• Assignee: Sijie Guo
• Reporter: Sijie Guo
• Created: 12/May/14 04:24
• Updated: 22/Jun/17 00:10
• Resolved: 22/Jun/17 00:10

Description

for performance consideration, the jira is targeting on improving ledger recovery. this ticket is to track improvements:

• add a parallel reading request in PendingReadOp (so when we read range of requests, we could callback individual entry if they are available)
• change recovery read to use batch read, so we could parallel reading entries to improve recovery time.

Issue Links

• is related to: DL-2 DistributedLog should work with the official apache bookkeeper

Sub-Tasks

• Ledger Recovery - Refactor PendingReadOp: Resolved
• Ledger Recovery - Add a parallel reading request in PendingReadOp: Resolved
• Ledger Recovery - Add a ReadEntryListener to callback on individual request: Resolved
• Ledger Recovery - allow batch reads in ledger recovery: Resolved
• Ledger Recovery - Add Test Case for Parallel Ledger Recovery: Resolved