Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-871

Change multilang heartbeat mechanism to multi-threading of subprocess

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: storm-multilang
    • Labels:
      None

      Description

      Having design constraint of multilang heartbeat, some issues are raised at the moment.
      (https://issues.apache.org/jira/browse/STORM-738 is a kind of reporting)

      I'm trying to add workarounds (https://issues.apache.org/jira/browse/STORM-742 and so on), but if we can get rid of design constraint it would be really great.

      Maybe we can use pid file of subprocess (subprocess write it from sendpid()) to check subprocess heartbeat from ShellSpout / ShellBolt.
      Letting subprocess launch new thread which writes pid file periodically, to make sure "modified time" of file is periodically up to date. (It is just an idea, and it should be validated.)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                kabhwan Jungtaek Lim
                Reporter:
                kabhwan Jungtaek Lim
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: