[OOZIE-1761] Improve sharelib purging logic

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.1.0
• Assignee: Purshotam Shah
• Reporter: Purshotam Shah
• Created: 27/Mar/14 18:53
• Updated: 09/Dec/14 00:45
• Resolved: 04/Apr/14 19:24

Description

Currently oozie server purges anything older then 7 (oozie.ShareLibService.temp.sharelib.retention.days) days, keeping 2 latest dir.

Which might be faulty.

Take an example.
Currently used sharelib is sharelib-1, which is created a month before.
If I restart Oozie server 2 times, it will create directory sharelib-2 and sharelib-3 and delete anything older than 7 days( keeping two latest).
In this case oozie server will delete sharelib-1, which is wrong and all running jobs will start failing.

Better logic is to keep all share-lib between current timestamp and 7days old + 1 latest sharelib older than 7 days.

Issue Links

• links to: RB