[BEAM-13865] A generic Beam IO Sink for Java

• Type: Bug
• Status: Open
• Priority: P2
• Resolution: Unresolved
• Component/s: io-ideas
• Labels: full-time gsoc gsoc2022 mentor
• Assignee: Unassigned
• Reporter: Pablo Estrada
• Created: 09/Feb/22 21:36
• Updated: 04/Jun/22 23:22

Description

It would be desirable to develop a Beam Sink that supports all of the 'best practices' like throttling, auto-sharding, exactly-once capabilities, etc.

A design proposal is here: https://docs.google.com/document/d/1UIWv6wnD86GYAkeqbVWCG3mx4dTZ9WstUUThPWQmcFM/edit#heading=h.smc16ifdre2

A prototype for the API and parts of implementation is here: https://github.com/apache/beam/pull/16763

Contact Pablo Estrada on [e-mail] if you have questions, or comment here.

Issue Links

• is cloned by: BEAM-14089 CLONE - A generic Beam IO Sink for Java