Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-914

Design and implement a composable operator APIs for direct programming of DAG in Java

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      In the process of design/refining the physical operator layer for SAMZA-552, there is a need to design/implement a set of fluent programming APIs s.t. users may be able to directly write Java programs using the physical operators.

      The programming APIs would serve as an intermediate layer that serves the following purposes:

      1. Users can choose to directly use physical operators (like window/join/filter etc.) in their Java code
      2. The SQL parser and engine can use this API to construct the physical operators and the execution DAG.
      1. rb47835 (1).patch
        291 kB
        Yi Pan (Data Infrastructure)
      2. SAMZA-914_ operator Java programming API - Google Docs.pdf
        706 kB
        Yi Pan (Data Infrastructure)

        Issue Links

          Activity

          Hide
          nickpan47 Yi Pan (Data Infrastructure) added a comment -

          The initial draft of operator programming APIs (stubs) and example application code are here

          Show
          nickpan47 Yi Pan (Data Infrastructure) added a comment - The initial draft of operator programming APIs (stubs) and example application code are here
          Hide
          navina Navina Ramesh added a comment -

          Yi Pan (Data Infrastructure) The link says "Review Request is private". Can you make it accessible ?

          Show
          navina Navina Ramesh added a comment - Yi Pan (Data Infrastructure) The link says "Review Request is private". Can you make it accessible ?
          Hide
          nickpan47 Yi Pan (Data Infrastructure) added a comment -

          Ah... sorry I forgot that. It is public now.

          Thanks!

          Show
          nickpan47 Yi Pan (Data Infrastructure) added a comment - Ah... sorry I forgot that. It is public now. Thanks!
          Hide
          nickpan47 Yi Pan (Data Infrastructure) added a comment -

          Merged and submitted to samza-sql branch

          Show
          nickpan47 Yi Pan (Data Infrastructure) added a comment - Merged and submitted to samza-sql branch

            People

            • Assignee:
              nickpan47 Yi Pan (Data Infrastructure)
              Reporter:
              nickpan47 Yi Pan (Data Infrastructure)
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development