[GOBBLIN-713] Lazy load job specification from job catalog to avoid OOM issue when JobCatalog is bootup.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.15.0
• Assignee: Unassigned
• Reporter: Kuai Yu
• Created: 26/Mar/19 21:52
• Updated: 27/Mar/19 22:51
• Resolved: 27/Mar/19 22:51

Description

Today whenever the job catalog is restarted, all the job specs are load into memory. This can cause OOM issue in our production load. Ticket was created to provide an easy way to load job spec without materializing all the job specs into memory. 

Issue Links

• links to: GitHub Pull Request #2581