Uploaded image for project: 'Metron (Retired)'
  1. Metron (Retired)
  2. METRON-1888

Default Topology Settings in MPack Cause Profiler to Stall

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Done
    • Major
    • Resolution: Done
    • None
    • 0.7.0
    • None

    Description

      The default max spout pending set by the Mpack for the Profiler topology is 300. This value is too low and causes the topology to stall and stop consuming messages.

       

      The Profiler topology is the only Metron topology that uses Storm's windowing support.  Storm will queue up messages for the window length (by default 30 seconds) and process each of those windows.

       

      This causes Storm to need to "hang on" to tuples longer than the other topologies and this requires a much greater max spout pending value.

       

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. METRON-1897 Warn About Max Spout Pending Exceeded in Profiler Topology

          • Major - Major loss of function.
          • To Do
          links to

          Web Link GitHub Pull Request #1276

          Activity

            People

              nickwallen Nick Allen
              nickwallen Nick Allen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: