Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1073 Simpler model for Namenode's fs Image and edit Logs
  3. HDFS-1473

Refactor storage management into separate classes than fsimage file reading/writing

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.22.0, 0.23.0
    • namenode
    • None
    • Reviewed

    Description

      Currently the FSImage class is responsible both for storage management (eg moving around files, tracking file names, the VERSION file, etc) as well as for the actual serialization and deserialization of the "fsimage" file within the storage directory.

      I'd like to refactor the loading and saving code into new classes. This will make testing easier and also make the major changes in HDFS-1073 easier to understand.

      Attachments

        1. hdfs-1473.txt
          75 kB
          Todd Lipcon
        2. hdfs-1473.txt
          0.6 kB
          Todd Lipcon
        3. hdfs-1473.txt
          74 kB
          Todd Lipcon
        4. hdfs-1473-followup.2.txt
          9 kB
          Todd Lipcon
        5. hdfs-1473-followup.3.txt
          9 kB
          Todd Lipcon
        6. hdfs-1473-followup.txt
          6 kB
          Todd Lipcon
        7. hdfs-1473-prelim.txt
          73 kB
          Todd Lipcon

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1489 breaking the dependency between FSEditLog and FSImage

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1506 Refactor fsimage loading code

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: