[FLINK-12752] Add Option to Pass Seed for JobID Hash for StandaloneJobClusterEntrypoint

• Type: Sub-task
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: flink-docker
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Konstantin Knauf
• Created: 05/Jun/19 17:46
• Updated: 16/Apr/21 11:29

Description

In case of a standalone job cluster setup, we would like to generate random a JobID for every job, but the JobID nevertheless needs to stay constant between JobManager process restarts.

For this, I would like to add an additional command line options for the StandaloneJobClusterEntrypoint called jobId-seed. job-id-seed and job-id are mutually exclusive.

• --jobId
• --jobId-seed
• (default)

On Kubernetes, this new command line argument would need to be set to a property which is stable over Pod Restarts but changes for different K8s Jobs or K8s Deployments.

Open Questions

• what available information to use a seed for deployments on Kubernetes?

Issue Links

• blocks: FLINK-12885 Rename "Job Cluster" to "Application Cluster" in READMEs and Documentation
• links to: GitHub Pull Request #8741