[STORM-3583] Handle exceptions when AsyncLocalizer tries to get local resources

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: storm-server
• Labels: pull-request-available
• Assignee: Rui Li
• Reporter: Kishor Patil
• Created: 18/Feb/20 17:05
• Updated: 01/Jul/20 14:07
• Resolved: 23/Apr/20 18:58

Description

Supervisor relies on AsyncLocalizer to download blobs from blob store.
AsyncLocalizer uses downloadService pool to process CompletableFuture objects in parallel.

We have noticed a case that while the downloading task is waiting for a thread to execute, new assignment changes will try to release the slot by dereferences all of the related local resources.

However, reading local resources assumes two base blob downloading task have been completed which is not always true.
 

Issue Links

• links to: GitHub Pull Request #3210
• links to: GitHub Pull Request #3226