Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-68

Need multiple output streams for a bolt in Trident

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: storm-core
    • Labels:
      None

      Description

      https://github.com/nathanmarz/storm/issues/638

      Nathan suggested to open an issue for this:

      Transactional Topologies gave us the flexibility to have multiple output streams from a bolt from which different downstreamer bolts can subscribe per bolt per stream; while in Trident, though the bolt can take multiple input streams, it is not possible (as per our understanding) to emit different streams. All downstreamer bolts have to subscribe to the same output stream from the bolt.
      The only way to solve this in the current system is to tunnel multiple streams in the outgoing stream, which all downstreamers receive and then demultiplex it in each of those bolts and select whatever stream the bolt is interested in. This will have perf implications for our usecases which deals with good amount of traffic.

      The discussion:
      https://groups.google.com/forum/#!topic/storm-user/G8POD1Hb89I

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            xumingming James Xu
          • Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development