Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1761

Improve sharelib purging logic

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently oozie server purges anything older then 7 (oozie.ShareLibService.temp.sharelib.retention.days) days, keeping 2 latest dir.

      Which might be faulty.

      Take an example.
      Currently used sharelib is sharelib-1, which is created a month before.
      If I restart Oozie server 2 times, it will create directory sharelib-2 and sharelib-3 and delete anything older than 7 days( keeping two latest).
      In this case oozie server will delete sharelib-1, which is wrong and all running jobs will start failing.

      Better logic is to keep all share-lib between current timestamp and 7days old + 1 latest sharelib older than 7 days.

        Attachments

        1. OOZIE-1761-V1.patch
          14 kB
          Purshotam Shah

          Issue Links

            Activity

              People

              • Assignee:
                puru Purshotam Shah
                Reporter:
                puru Purshotam Shah
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: