Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2190

Topology submission blocked behind scheduling

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0, 1.0.0, 2.0.0
    • Fix Version/s: 2.0.0, 1.1.0
    • Component/s: storm-core
    • Labels:
      None

      Description

      The submit-lock in nimbus seems to protect some very large and slow sections of code. As more and more topologies are submitted scheduling can take longer and longer to complete making submitting a topology take increasingly longer. But most of scheduling does not need to be protected by this lock. Only a small section of the scheduler pulls state from zookeeper that the lock protects elsewhere.

      We should split this lock up and protect scheduling separate from protecting StormBase stored in zk.

        Attachments

          Activity

            People

            • Assignee:
              revans2 Robert Joseph Evans
              Reporter:
              revans2 Robert Joseph Evans
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3.5h
                3.5h