Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1130

ApplicationRunner for running StreamApplication

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.13.0
    • 0.15.0
    • None
    • None

    Description

      ApplicationRunner is the layer between high fluent API and physical execution. It is responsible for planning execution, materializing the streams and configs, and running the physical execution. For Samza, we will provide three kinds of ApplicationRunners:

      • RemoteApplicationRunner: this is for running Samza applications on remote clusters such as Yarn
      • LocalApplicationRunner: this is for running Samza applications on locally (coordination may be needed among local processors)
      • TestApplicationRunner: this is for running Samza applications in the testing environment which can support input sources for testing such as collections or files.

      Attachments

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue SAMZA-1151 create ZkCoordination service

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1171 Rewrite config in ApplicationRunnerMain when creating the application runner

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1172 Fix for the topological sort to handle single-node loop correctly

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1203 Use ProcessorId instead of Zk node Id in JobModel generation

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1067 Physical execution plan for logic expressions written in fluent API

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1122 Rename ExecutionEnvironment to ApplicationRunner

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1204 Visualize StreamGraph and ExecutionPlan

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1218 Support StreamTaskFactory and AsyncStreamTaskFactory in LocalApplicationRunner

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1222 Clean up LocalApplicationRunner

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-1267 ApplicationRunner#getLocalRunner returns null

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1123 Create intermediate stream in partitionBy() operator

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1131 RemoteApplicationRunner for cluster-based Samza applications

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1132 LocalApplicationRunner for local exeuction of Samza StreamApplication

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1133 TestApplicationRunner for executing Samza StreamApplication in testing environment

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. SAMZA-1089 JobRunner should support kill and status commands.

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. SAMZA-1137 Instantiate ApplicationRunner in SamzaContainer

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. SAMZA-1178 Generate JSON for Stream Graph and Execution Plan

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. SAMZA-1179 Documentation of ApplicationRunner

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. SAMZA-1186 Rename Processor to Job

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. SAMZA-1041 Multi-stage feature for Samza

          • Major - Major loss of function.
          • In Progress

          Activity

            People

              xinyu Xinyu Liu
              xinyu Xinyu Liu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: