Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-3583

Handle exceptions when AsyncLocalizer tries to get local resources

    XMLWordPrintableJSON

    Details

      Description

      Supervisor relies on AsyncLocalizer to download blobs from blob store.
      AsyncLocalizer uses downloadService pool to process CompletableFuture objects in parallel.

      We have noticed a case that while the downloading task is waiting for a thread to execute, new assignment changes will try to release the slot by dereferences all of the related local resources.

      However, reading local resources assumes two base blob downloading task have been completed which is not always true.
       

        Attachments

          Activity

            People

            • Assignee:
              li530 Rui Li
              Reporter:
              kishorvpatil Kishor Patil
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 4h 50m
                4h 50m