Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2738

The number of ackers should default to the number of actual running workers on RAS cluster

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: None

      Description

      Problem:
      If topology.acker.executors is not set, the number of ackers will be equal to topology.workers. But on RAS cluster, we don't set topology.workers because the number of workers will be determined by the scheduler. So in this case, the number of ackers will always be 1 (see attached screenshot)

      Analysis:
      The number of ackers has to be computed before scheduling happens, so it knows how to schedule the topology. The number of workers is not set until the topology is scheduled, so it is a bit of a chicken and egg problem.

      Solution:
      We could probably use the total amount of requested memory when the topology is submitted divided by the memory per worker to get an estimate that is better than 1.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ethanli Ethan Li
                Reporter:
                ethanli Ethan Li
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m