Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2190

Topology submission blocked behind scheduling

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.0, 1.0.0, 2.0.0
    • 2.0.0, 1.1.0
    • storm-core
    • None

    Description

      The submit-lock in nimbus seems to protect some very large and slow sections of code. As more and more topologies are submitted scheduling can take longer and longer to complete making submitting a topology take increasingly longer. But most of scheduling does not need to be protected by this lock. Only a small section of the scheduler pulls state from zookeeper that the lock protects elsewhere.

      We should split this lock up and protect scheduling separate from protecting StormBase stored in zk.

      Attachments

        Activity

          People

            revans2 Robert Joseph Evans
            revans2 Robert Joseph Evans
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3.5h
                3.5h