[HDFS-2018] 1073: Move all journal stream management code into one place

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0-alpha
• Hadoop Flags: Reviewed
• Assignee: Ivan Kelly
• Reporter: Ivan Kelly
• Created: 31/May/11 10:45
• Updated: 28/Sep/15 20:58
• Resolved: 06/Sep/11 21:09

Description

Currently in the HDFS-1073 branch, the code for creating output streams is in FileJournalManager and the code for input streams is in the inspectors. This change does a number of things.

• Input and Output streams are now created by the JournalManager.
• FSImageStorageInspectors now deals with URIs when referring to edit logs
• Recovery of inprogress logs is performed by counting the number of transactions instead of looking at the length of the file.

The patch for this applies on top of the HDFS-1073 branch + HDFS-2003 patch.

Issue Links

• blocks: HDFS-2158 Add JournalSet to manage the set of journals.
• incorporates: HDFS-2225 HDFS-2018 Part 1 : Refactor file management so its not in classes which should be generic
• is depended upon by: HDFS-2188 HDFS-1580: Make FSEditLog create its journals from a list of URIs rather than NNStorage
• is related to: HDFS-2088 1073: Move edits log archiving logic into FSEditLog/JournalManager
• requires: HDFS-2227 HDFS-2018 Part 2 : getRemoteEditLogManifest should pull it's information from FileJournalManager