Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1763

Implement async versions of the table API

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.0
    • Component/s: None
    • Labels:
      None

      Description

      In Samza, Table API provides a consistent and simple way to perform IO with non-stream data sources, eg. key-value stores. It can be used in high-level API in the form of stream-table join and sendTo operators. Low-level API integration is also being worked on. 

      The current set of Table APIs only consists of synchronous versions in that all calls are blocking. Unlike local tables, there is a strong need to have async for remote tables to deliver higher throughput which can otherwise be hindered with full sync executions. 

      Given there is currently no async support in Samza high-level API, the design in this document is mainly targeted for low-level API. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                pdu-mn1 Peng Du
                Reporter:
                pdu-mn1 Peng Du
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: