Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11463 Rework end-to-end tests in Java
  3. FLINK-14700

Consider to set the random listen port in e2e flink cluster.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Test Infrastructure
    • Labels:
      None

      Description

      Have a discussion with Chesnay Schepler in PR https://github.com/apache/flink/pull/10106 , we plan to set the ports of e2e testing flink cluster to be 0, which means it will select the port randomly to bind & listen. That would be helpful to avoid port conflicts when running parallel e2e tests. But that need some way to find the listen port because the tests will wait the port to be available ( by requesting to the port repeatably). we discussed the three ways to find the port:
      1. Sweep the listening ports;
      2. MiniCluster pre-check the available ports and choose one to listen , then persist the port to flink-conf.xml;
      3. A regular parser to extract the binded port in log messages;
      ...
      Anyway, filed the issue to address the things here, will try to fix it.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              openinx Zheng Hu
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: