Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2122

Supervisor V2 can use a lot more memory

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: storm-core
    • Labels:
      None

      Description

      When launching a worker the supervisor will read in the complete topology to get a small amount of data out of it. This can be very large. In the past we would launch the workers one at a time, so we only needed enough memory to read it in once, now we are doing it in parallel, and lots of these tend to show up very close to one another. We need to find a way to make it so that we read the data one, and ideally cache it someplace that everyone can share.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                revans2 Robert Joseph Evans
                Reporter:
                revans2 Robert Joseph Evans
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m