[FLINK-10294] Split MiniClusterResource to be usable in runtime/streaming-java/clients

• Type: Technical Debt
• Status: Closed
• Priority: Not a Priority
• Resolution: Fixed
• Affects Version/s: 1.7.0
• Component/s: API / DataStream, Tests
• Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned
• Assignee: Unassigned
• Reporter: Chesnay Schepler
• Created: 06/Sep/18 09:17
• Updated: 11/Nov/22 09:24
• Resolved: 11/Nov/22 09:24

Description

Problem

The MiniClusterResource is a utility class to create and manage flink clusters for testing purposes. It is incredibly convenient, but unfortunately resides in flink-test-utils which depends on flink-runtime, flink-streaming-java and flink-clients, making the class not usable in these modules.

The current version does require these dependencies, but only for specific, optional, parts. streaming-java is only required for accessing TestStreamEnvironment and flink-clients only for tests that want to work against a ClusterClient.

Proposal

Split the MiniClusterResource as follows:

1)

Remove client/streaming-java dependent parts and move the class to flink-runtime.

2)

Add a new class StreamingMiniClusterResourceExtension that accepts a MiniClusterResource as an argument and contains the streaming parts.
Usage would look like this:

private final MiniClusterResource cluster = ...
private final StreamingMiniClusterResourceExtension ext = new StreamingMiniClusterResourceExtension(cluster);

@Rule
public RuleChain chain= RuleChain
	.outerRule(cluster) 
	.around(ext),

3)

Add a new class ClientMiniClusterResourceExtension that accepts a MiniClusterResource as an argument and contains the client parts.
Usage would look like this:

private final MiniClusterResource cluster = ...
private final ClientMiniClusterResourceExtensionext = new ClientMiniClusterResourceExtension(cluster);

@Rule
public RuleChain chain= RuleChain
	.outerRule(cluster) 
	.around(ext),

till.rohrmann WDYT?