[AURORA-263] Support a min guaranteed task history retention period

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Component/s: Scheduler
• Assignee: Maxim Khutornenko
• Reporter: Maxim Khutornenko
• Created: 14/Mar/14 21:37
• Updated: 27/Mar/14 17:20
• Resolved: 21/Mar/14 19:11

Description

Task history currently does not deliver any retention guarantees beyond a max of 100 tasks per job over at most 2 days (whichever comes first). This makes any immediate event processing (i.e. SLA monitoring) impossible under heavy turn over.

Have the HistoryPrunner support a min configurable retention period (e.g. 2 minutes) to mitigate the above problem. The risk of overloading mem store is minimal due to throttling of flapping tasks.

Issue Links

• is related to: AURORA-261 on sandbox garbage collection, just de-link the slave HREF on the finished tasks page