Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.0.0
    • Component/s: storm-core
    • Labels:
      None

      Description

      Classes which run topologies often repeat the same code and pattern to:

      • populate the configuration from a file instead of ~/.storm
      • determine whether to run locally or remotely
      • set a TTL for a topology

      Flux provides an elegant way of dealing with these but sometimes it is simpler to define a topology in Java code.

      In StormCrawler, we implemented an abstract class named ConfigurableTopology which can be extended and saves users the hassle of having to write code for the things above. I will open a PR containing this class so that we can discuss and comment whether it is of any use at all.

        Issue Links

          Activity

          Hide
          kevpeek Kevin Peek added a comment -

          FWIW Flux does support some degree of creating topologies in code. See the docs here under the heading "Existing Topologies"
          http://storm.apache.org/releases/2.0.0-SNAPSHOT/flux.html

          It certainly doesn't cover every use case though.

          Show
          kevpeek Kevin Peek added a comment - FWIW Flux does support some degree of creating topologies in code. See the docs here under the heading "Existing Topologies" http://storm.apache.org/releases/2.0.0-SNAPSHOT/flux.html It certainly doesn't cover every use case though.
          Hide
          jnioche Julien Nioche added a comment -

          @kabhwan 1.x does not have the class LocalCluster in Java so we can't have ConfigurableTopology in storm-core as far as I can tell

          Show
          jnioche Julien Nioche added a comment - @kabhwan 1.x does not have the class LocalCluster in Java so we can't have ConfigurableTopology in storm-core as far as I can tell
          Hide
          kabhwan Jungtaek Lim added a comment -

          Thanks Julien Nioche, I merged into master.
          If you want me to port back this into 1.x branch please create a PR against 1.x branch and let me know. Thanks again!

          Show
          kabhwan Jungtaek Lim added a comment - Thanks Julien Nioche , I merged into master. If you want me to port back this into 1.x branch please create a PR against 1.x branch and let me know. Thanks again!

            People

            • Assignee:
              jnioche Julien Nioche
              Reporter:
              jnioche Julien Nioche
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 2h 10m
                2h 10m

                  Development