[BEAM-11410] Example of E2E test for Kafka environment

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.28.0
• Component/s: examples-java
• Assignee: Ilya Kozyrev
• Reporter: Ilya Kozyrev
• Created: 07/Dec/20 20:02
• Updated: 25/Jan/21 17:14
• Resolved: 25/Jan/21 17:14

Description

Kafka to Pub/Sub pipeline example needs to have e2e tests. However, in Beam Testing Guide https://cwiki.apache.org/confluence/display/BEAM/Contribution+Testing+Guide , we have not found examples or documentation for e2e tests that require Kafka environment can be set up.

During the investigation and with the help of our reviewers we found possible approaches for our issue. 

For Kafka, e2e test could use test container

These e2e test examples can be referenced in the https://cwiki.apache.org/confluence/display/BEAM/Contribution+Testing+Guide to serve examples of how customers may approach e2e testing of pipelines in their environments.

Issue Links

• links to: [Github] Pull Request #13636 (ramazan-yapparov)