[FLINK-20392] Migrating bash e2e tests to Java/Docker

• Type: Technical Debt
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Test Infrastructure, Tests
• Labels: auto-deprioritized-major auto-deprioritized-minor starter
• Assignee: Unassigned
• Reporter: Matthias Pohl
• Created: 27/Nov/20 12:55
• Updated: 30/Aug/23 12:58

Description

This Jira issue serves as an umbrella ticket for single e2e test migration tasks. This should enable us to migrate all bash-based e2e tests step-by-step.

The goal is to utilize the e2e test framework (see flink-end-to-end-tests-common). Ideally, the test should use Docker containers as much as possible disconnect the execution from the environment. A good source to achieve that is testcontainers.org.

The related ML discussion is Stop adding new bash-based e2e tests to Flink.

Sub-Tasks

• Migrate test_mesos_wordcount.sh: Closed
• Migrate test_mesos_multiple_submissions.sh: Closed
• Migrate test_netty_shuffle_memory_control.sh: Open
• Migrate test_batch_sql.sh: Open
• Migrate test_sql_client.sh: Open
• Migrate test_streaming_sql.sh: Open
• Migrate test_tpcds.sh: Open
• Migrate test_tpch.sh: Open
• Migrate test_table_shaded_dependencies.sh: Open
• Migrate test_pyflink.sh: Open
• Migrate test_pyflink_yarn.sh: Open
• Migrate test_kubernetes_pyflink_application.sh: Open
• Migrate test_kubernetes_embedded_job.sh: Open
• Migrate the Kubernetes Session Tests test_kubernetes_session.sh: Open
• Migrate test_kubernetes_application.sh: Open
• Migrate test_kubernetes_application_ha.sh: Open
• Migrate test_kubernetes_itcases.sh: Open