[HDFS-8302] Consolidate log purging logic in QJM and FJM

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Zhe Zhang
• Reporter: Zhe Zhang
• Created: 30/Apr/15 18:15
• Updated: 30/Apr/15 18:15

Description

When executing purgeLogsOlderThan, JNStorage purges both the current directory and the Paxos directory using its own logic:

  void purgeDataOlderThan(long minTxIdToKeep) throws IOException {
    purgeMatching(sd.getCurrentDir(),
        CURRENT_DIR_PURGE_REGEXES, minTxIdToKeep);
    purgeMatching(getPaxosDir(), PAXOS_DIR_PURGE_REGEXES, minTxIdToKeep);
  }

Meanwhile, FJM has its own logic of serving purgeLogsOlderThan, which is executed only under the legacy NFS-based journaling configuration.

This JIRA aims to consolidate these 2 separate purging procedures

Sub-Tasks

• QJM should purge old logs in the current directory through FJM: Patch Available
• Separate out shared log purging methods for QJM (Paxos directory) and FJM: Open