[BEAM-9893] Add SnowflakeIO to Java SDK

• Type: New Feature
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Affects Version/s: Not applicable
• Fix Version/s: Missing
• Component/s: io-ideas
• Assignee: Unassigned
• Reporter: Dariusz Aniszewski
• Created: 06/May/20 14:46
• Updated: 13/Jan/22 21:52
• Resolved: 15/May/21 17:59

Description

Creating java Snowflake connector which includes:

• batch processing connector provided by COPY operation from SnowflakeJDBC which will load/unload files staged on GCP,
• streaming processing thanks to SnowPipe mechanism and Snowflake Ingest Java library,
• Snowflake authentication mechanism.

Issue Links

• fixes: BEAM-9466 SnowflakeIO in python
• is a parent of: BEAM-9894 Add batch SnowflakeIO.Write to Java SDK
• is a parent of: BEAM-10331 Add SnowflakeIO to list of built-in IOs
• is a parent of: BEAM-9722 Add batch SnowflakeIO.Read to Java SDK
• is a parent of: BEAM-9896 Add streaming for SnowflakeIO.Write to Java SDK
• is a parent of: BEAM-10343 Add dispositions for SnowflakeIO.write
• is a parent of: BEAM-9897 Add cross-language support to SnowflakeIO.Read
• is a parent of: BEAM-9898 Add cross-language support to SnowflakeIO.Write
• is a parent of: BEAM-10669 Add support for Dataflow Templates
• is a parent of: BEAM-9895 Add integration test for batch SnowflakeIO Read and Write for Java SDK
• is a parent of: BEAM-10685 Add SnowflakeIO Streaming integration test
• is a parent of: BEAM-9899 Add integration tests for cross-language SnowflakeIO Read and Write