Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
When launching a worker the supervisor will read in the complete topology to get a small amount of data out of it. This can be very large. In the past we would launch the workers one at a time, so we only needed enough memory to read it in once, now we are doing it in parallel, and lots of these tend to show up very close to one another. We need to find a way to make it so that we read the data one, and ideally cache it someplace that everyone can share.
Attachments
Issue Links
- links to
