Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1489

breaking the dependency between FSEditLog and FSImage

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 0.21.0
    • None
    • namenode
    • None

    Description

      This is a refactor patch which its main concerns are:

      • breaking the dependency between FSEditLog and FSImage
      • Splitting the abstracting the error handling and directory management,
      • Decoupling Storage from FSImage.

      In order to accomplish the above goal, we will need to introduce new classes:

      • NNStorage: Will care about the storage. It extends Storage class, and will contain the StorageDirectories.
      • NNUtils: Some utility static methods on FSImage and FSEditLog will be moved here.
      • PersistenceManager: FSNameSystem will now be responsible for managing the FSImage & FSEditLog objects. There will be some logic that will have to moved out of FSImage to facilite this. For this we propose a PersistanceManager? object as follows.

      For more deep details, see the design document uploaded.

      Attachments

        1. hdfs_1489.pdf
          161 kB
          Diego Marron
        2. NNStorage.diff
          157 kB
          Ivan Kelly
        3. NNStorage.diff
          157 kB
          Ivan Kelly
        4. NNStorage.diff
          125 kB
          Ivan Kelly
        5. HDFS-1489.diff
          313 kB
          Ivan Kelly
        6. HDFS-1489.diff
          310 kB
          Ivan Kelly
        7. HDFS-1489.pdf
          115 kB
          Diego Marron

        Issue Links

          Activity

            People

              ikelly Ivan Kelly
              diegom Diego Marron
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: