[FLINK-25586] ExecutionGraphInfoStore in session cluster should split failed and successful jobs

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.12.7, 1.13.5, 1.14.2
• Component/s: Runtime / Coordination
• Assignee: Zhanghao Chen
• Reporter: Fang Yong
• Created: 10/Jan/22 07:14
• Updated: 08/Aug/22 02:13

Description

In flink session cluster, jobs are stored in `FileExecutionGraphInfoStore`. When the count of jobs in it reaches `jobstore.cache-size` or the live time of jobs reaches `jobstore.expiration-time`, the specify jobs will be removed. We can't holds too many jobs for performance reason, but we should hold failed jobs for longer time to trace the cause of failure. So it's better to split failed and successful jobs in `FileExecutionGraphInfoStore` and support independent max-capacity for them.