Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1489

breaking the dependency between FSEditLog and FSImage

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 0.21.0
    • None
    • namenode
    • None

    Description

      This is a refactor patch which its main concerns are:

      • breaking the dependency between FSEditLog and FSImage
      • Splitting the abstracting the error handling and directory management,
      • Decoupling Storage from FSImage.

      In order to accomplish the above goal, we will need to introduce new classes:

      • NNStorage: Will care about the storage. It extends Storage class, and will contain the StorageDirectories.
      • NNUtils: Some utility static methods on FSImage and FSEditLog will be moved here.
      • PersistenceManager: FSNameSystem will now be responsible for managing the FSImage & FSEditLog objects. There will be some logic that will have to moved out of FSImage to facilite this. For this we propose a PersistanceManager? object as follows.

      For more deep details, see the design document uploaded.

      Attachments

        1. hdfs_1489.pdf
          161 kB
          Diego Marron
        2. HDFS-1489.diff
          313 kB
          Ivan Kelly
        3. HDFS-1489.diff
          310 kB
          Ivan Kelly
        4. HDFS-1489.pdf
          115 kB
          Diego Marron
        5. NNStorage.diff
          157 kB
          Ivan Kelly
        6. NNStorage.diff
          157 kB
          Ivan Kelly
        7. NNStorage.diff
          125 kB
          Ivan Kelly

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ikelly Ivan Kelly
            diegom Diego Marron
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment