[OAK-7854] Add liveliness monitoring for FileStore background operations

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.10.0, 1.6.14, 1.8.9, 1.4.24
• Component/s: segment-tar
• Assignee: Michael Dürig
• Reporter: Michael Dürig
• Created: 19/Oct/18 10:14
• Updated: 26/Jun/19 10:41
• Resolved: 23/Oct/18 12:49

Description

The FileStore background operations are ultimately executed through a ScheduledExecutorService. In the case this scheduling gets blocked (e.g. because of a deadlock or lock contention in one of its tasks) there is chance of repository corruption.

To minimise potential data loss we should implement monitoring endpoints for the vital background operations. This would allow deployments to take action early in case of failures and thus minimise potential data loss and simplify recovery.