[FLINK-14700] Consider to set the random listen port in e2e flink cluster.

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Test Infrastructure
• Assignee: Unassigned
• Reporter: Zheng Hu
• Created: 11/Nov/19 07:15
• Updated: 23/Apr/21 13:56

Description

Have a discussion with chesnay in PR https://github.com/apache/flink/pull/10106 , we plan to set the ports of e2e testing flink cluster to be 0, which means it will select the port randomly to bind & listen. That would be helpful to avoid port conflicts when running parallel e2e tests. But that need some way to find the listen port because the tests will wait the port to be available ( by requesting to the port repeatably). we discussed the three ways to find the port:
1. Sweep the listening ports;
2. MiniCluster pre-check the available ports and choose one to listen , then persist the port to flink-conf.xml;
3. A regular parser to extract the binded port in log messages;
...
Anyway, filed the issue to address the things here, will try to fix it.