Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-11287

Add General purpose Write operation to the cross-language Spanner transform

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Triage Needed
    • Priority: P2
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: cross-language, io-java-gcp, io-py-gcp
    • Labels:
      None

      Description

      https://github.com/apache/beam/pull/12611 largely addresses this by adding individual xlang wrappers for delete/replace/insert/update/insert_or_update operations restricted to a single table.

      The only thing missing is a general purpose "write" transform that can accept general mutations (multiple tables, multiple operations). To get that right will require some design work and likely some new features in portable schemas (unions).

        Attachments

          Issue Links

          relates to

          Sub-task - The sub-task of the issue BEAM-10139 Add cross-language wrapper for Java's SpannerIO Write

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                piotr-szuberski Piotr Szuberski
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: