Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1549

Add support for extending tuple tree timeout

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.0.0, 2.0.0
    • Component/s: storm-core
    • Labels:
      None

      Description

      During the discussion of https://github.com/apache/storm/pull/700 the issue of allowing timeout extension in case of unavailable external components (such as a web service) came up.

      The current implementation makes tuples fail at a set interval, regardless of whether or not replaying them is necessary. This can be irritating in topologies that emit to multiple services, since one hanging service will cause replays to hit all the working services as well.

      I suggest adding a resetTimeout function to IOutputCollector, which will make the relevant ackers and spouts reinsert the tuple tree information in their pending maps.

      The intended usage is that a bolt can call this function on an interval if it needs to delay expiration, for example if it needs to retry calling a web server a few times. It may also be useful for slow topologies that want Storm to detect hanging/dropped tuples faster than the max expected complete latency of the topology.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Srdo Stig Rohde Døssing
                Reporter:
                Srdo Stig Rohde Døssing
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: