[FLINK-27075] Migrate CI from Azure to Github Actions

• Type: Technical Debt
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Build System / CI
• Labels: github-actions
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 06/Apr/22 06:49
• Updated: 20/Dec/23 11:55

Description

Current base commit: master@011b6b44 (related AzureCI)

Issue Links

• is blocked by: FLINK-27069 Fix the potential memory corruption in Thread Mode
• is related to: FLINK-26658 Migrate documentation build to Github Actions
• is related to: FLINK-27488 Migrate flink-docker CI to github actions
• is superceded by: FLINK-33901 Trial Period: GitHub Actions
• Testing discovered: FLINK-33578 Remove scala-2.12 system variable
• links to: Branch for initial POC in XComp/flink fork

Sub-Tasks

• Setup runners: Open
• Setup per-commit builds: Open
• Setup cron jobs: Open
• Enable builds for pull requests: Open
• Remove Azure integration: Open
• Think about installing Java instead of providing it through Docker: Open
• JoinITCase.testRightOuterJoin failed due to heartbeat timeout: Open
• Supported maximum parallel jobs: Open
• Test CI on arm: Open
• Job (and its data) is lost: Open
• FileUtilsTest.testDeleteDirectoryConcurrently failed (no progress/output): Open
• SemiJoinITCase.testRewriteScalarQueryWithCorrelation3 failed due to heartbeat timeout: Open
• composite actions do not work in release branchs where GHA work wasn't backported: Open
• Docker pull failed: Open
• Python e2e test fails with exit code 1: Open
• StreamTaskSelectiveReadingTest.testReadFinishedInput(StreamTaskSelectiveReadingTest timed out: Open
• ActiveResourceManagerFactoryTest.testGetEffectiveConfigurationForResourceManagerCoarseGrained failed with 239 exit code: Open
• RetryingRegistrationTest.testRetryConnectOnFailure failed: Open