Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2126 Improve Namenode startup time [umbrella task]
  3. HDFS-1826

NameNode should save image to name directories in parallel during upgrade

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • namenode
    • None
    • Reviewed
    • I've committed this. Thanks, Matt!

    Description

      Currently namenode saves a new image to all its name directories in sequence during upgrade. We should make it to do in parallel to speedup namenode upgrade. Also it should not save its image to edits directories.

      Attachments

        1. 1826_FSImageWrite_concur_upgrade_v1.patch
          3 kB
          Matthew Foley
        2. 1826_FSImageWrite_concur_upgrade_v3.patch
          11 kB
          Matthew Foley
        3. 1826_FSImageWrite_concur_upgrade_v4.patch
          11 kB
          Matthew Foley
        4. 1826_FSImageWrite_concur_upgrade_v4.patch
          11 kB
          Matthew Foley

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-1071 savenamespace should write the fsimage to all configured fs.name.dir in parallel

          • Major - Major loss of function.
          • Closed

          Activity

            People

              mattf Matthew Foley
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: