[BEAM-10429] JdbcIO for cross-language timing out on beam_PostCommit_XVR_Flink

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Cannot Reproduce
• Affects Version/s: Not applicable
• Fix Version/s: Not applicable
• Component/s: cross-language
• Assignee: Unassigned
• Reporter: Piotr Szuberski
• Created: 09/Jul/20 06:04
• Updated: 13/Mar/21 04:04
• Resolved: 13/Mar/21 04:04

Description

CrossLanguageJdbcIOTest are timing out on Jenkins after submitting `Run XVR_Flink PostCommit` job.

For now the tests run on Flink and Spark on Python 3.8 Postcommit suite like KafkaIO cross-language test.

How to reconstruct it:

1. Add @attr('UsesCrossLanguageTransforms') to the CrossLanguageJdbcIOTest class
2. Use
   expansion_jar = os.environ.get('EXPANSION_JAR')
   port = os.environ.get('EXPANSION_PORT')
   address = 'localhost:%s' % port
   and pass the address as expansion_service param of the write and read transform.
3. Add
   p.get_pipeline_options().view_as(DebugOptions).experiments.append('jar_packages=' + expansion_jar)
   to the pipeline
4. Run :runners:flink:1.10:job-server:validatesCrossLanguageRunner task locally and `Run XVR_Flink PostCommit` on Jenkins

Examples of the customization are in xlang_parquetio_test.py

In my case on OSX everything passed fine locally and timeouted on Jenkins.