Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1458

Improve checkpoint performance by avoiding unnecessary image downloads

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.23.0
    • namenode
    • None
    • Reviewed

    Description

      If secondary namenode could verify that the image it has on its disk is the same as the one in the primary NameNode, it could skip downloading the image from the primary NN, thus completely eliminating the image download overhead.

      Attachments

        1. checkpoint-checkfsimageissame.patch
          10 kB
          Yilei Lu
        2. trunkNoDownloadImage.patch
          6 kB
          Hairong Kuang
        3. trunkNoDownloadImage1.patch
          9 kB
          Hairong Kuang
        4. trunkNoDownloadImage2.patch
          9 kB
          Hairong Kuang
        5. trunkNoDownloadImage3.patch
          9 kB
          Hairong Kuang

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-1904 Secondary Namenode dies when a mkdir on a non-existent parent directory is run

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-1627 Fix NullPointerException in Secondary NameNode

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-903 NN should verify images and edit logs on startup

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-1435 Provide an option to store fsimage compressed

          • Major - Major loss of function.
          • Closed

          Activity

            People

              hairong Hairong Kuang
              hairong Hairong Kuang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: