[BEAM-14048] [CdapIO] Design and implement ConfigWrapper for building CDAP PluginConfigs

• Type: Task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: io-java-cdap
• Labels: cdap-io-sprint-1

Language

Java

• Assignee: Vitaly Terentyev
• Reporter: Elizaveta Lomteva
• Due: 07/Mar/22
• Created: 04/Mar/22 14:47
• Updated: 18/May/22 15:56
• Resolved: 18/May/22 15:56

Description

Context:

CDAP plugins use their configuration classes (ex. SalesforceSinkConfig) to set the required parameters to prepare and run a pipeline in Source or Sink classes (ex. SalesforceBatchSink). The config instance is accepted as a Source/Sink constructor argument.

The configuration classes are usually placed in the cdap/plugin/{<plugin name>}/plugin/{sink|source}/{batch|streaming} folder (ex. Salesforce repo).

Task Description:

Required to design wrapper class(es) for the CDAP plugin config class so that the CDAP plugin config instance can be created in the Apache Beam connector based on user input and used when creating CDAP Source or Sink.

Acceptance criteria:

Design and source code of CDAP Config wrapper that will

1. accept custom parameters as constructor arguments (JSON/string or something else)

1. return an instance of plugins configuration class (ex. SalesforceSinkConfig)

Issue Links

• links to: GitHub Pull Request #17051
• links to: GitHub Pull Request #17150