[HDFS-3956] QJM: purge temporary files when no longer within retention period

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: QuorumJournalManager (HDFS-3077)
• Fix Version/s: QuorumJournalManager (HDFS-3077)
• Component/s: ha
• Target Version/s: QuorumJournalManager (HDFS-3077)
• Hadoop Flags: Reviewed
• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 19/Sep/12 03:20
• Updated: 19/Sep/12 23:43
• Resolved: 19/Sep/12 23:43

Description

After doing a bunch of fault testing, I noticed that the JNs had a bunch of temporary files left around in their journal directories which were no longer within the retention period. For example, if a JN crashes in the middle of recovery, it can leave around a file like edits_inprogress_123.epoch=10. These files are handy to keep around for forensics/debugging while they are still in their retention period, but we should not leave them forever. The normal purging policy should apply.