[FLINK-9030] JobManager fails to archive job to FS when TM is lost

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 1.4.0
• Component/s: Deployment / Mesos, Runtime / Coordination
• Assignee: Unassigned
• Reporter: Jared Stehler
• Created: 20/Mar/18 13:55
• Updated: 06/Nov/20 13:08
• Resolved: 06/Nov/20 13:08

Description

We are running flink on mesos, and are finding that when a job fails due to a task manager getting lost (from an OOM kill), the job isn't archived properly into the history server dir on the filesystem. 

When this happens, the job does appear in the finished listing in the job manager's in-memory archive view, and is accessible in the running job manager's rest api, but obviously not in the history server's rest api.

This is causing us issues as we are using the history server as a system of record for canceled or failed jobs in order to determine previous savepoint / external checkpoints.