[FLINK-28183] flink-python is lacking several test dependencies

• Type: Technical Debt
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.16.0
• Fix Version/s: 1.16.0
• Component/s: API / Python, Build System
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 21/Jun/22 13:12
• Updated: 09/Aug/22 02:24
• Resolved: 09/Aug/22 02:24

Description

The pyflink_gateway_server searches the output directories of various modules to construct a test classpath.
Half of these are not declared as actual test dependencies in maven. Because of that there are no guarantees that these modules are actually built before flink-python.

Additionally there seem to be no safeguards in place to verify that these jars actually exist.

Considering that this is only required for testing most of this logic should also be moved into maven, copying these dependencies to some directory under flink-python/target, to make this de-facto build logic more discoverable.

Issue Links

• relates to: FLINK-28194 Remove workaround around avro sql jar
• links to: GitHub Pull Request #20470