Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1073

Design top-level fluent APIs operators that are capable to be deployed in multi-stage jobs

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      It would be nice to allow users to stay at logic level when using fluent API's operators, w/o concerning about physical partitions of the stream and potential grouping of operators into multiple / single Samza jobs (SAMZA-1041).

      Hence, the fluent API needs to be able to express the physical topics as boundaries between stages in the single logic DAG.

      Besides, users should be able to use fluent API to describe a logic expression at top level, not within a job or within a task.

        Attachments

          Activity

            People

            • Assignee:
              nickpan47 Yi Pan (Data Infrastructure)
              Reporter:
              nickpan47 Yi Pan (Data Infrastructure)
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: