[FLINK-26641] Optimize the time of fetching job status in the job submission of session cluster

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.16.0
• Component/s: Client / Job Submission, Runtime / REST
• Labels: pull-request-available
• Assignee: Yangze Guo
• Reporter: Yangze Guo
• Created: 15/Mar/22 02:58
• Updated: 17/Mar/22 02:02
• Resolved: 17/Mar/22 02:02

Description

Currently, in the session cluster, the client will wait until the job initialization is finished in the job submission period. However, it will first get the job details from the `ExecutionGraphCache`. For short queries in OLAP scenarios, the job might have been finished before the cache refreshed, which increase the e2e time of fetching the result.

We proposed to introduce a REST API for the job status to replace it.

Issue Links

• links to: GitHub Pull Request #19095