Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-12979

StandbyNode should upload FsImage to ObserverNode after checkpointing.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 3.3.0, 3.1.4, 3.2.2
    • hdfs
    • None
    • Reviewed

    Description

      ObserverNode does not create checkpoints. So it's fsimage file can get very old making bootstrap of ObserverNode too long. A StandbyNode should copy latest fsimage to ObserverNode(s) along with ANN.

      Attachments

        1. HDFS-12979.001.patch
          3 kB
          Chen Liang
        2. HDFS-12979.002.patch
          6 kB
          Chen Liang
        3. HDFS-12979.003.patch
          11 kB
          Chen Liang
        4. HDFS-12979.004.patch
          14 kB
          Chen Liang
        5. HDFS-12979.005.patch
          16 kB
          Chen Liang
        6. HDFS-12979.006.patch
          16 kB
          Chen Liang
        7. HDFS-12979.007.patch
          26 kB
          Chen Liang
        8. HDFS-12979.008.patch
          26 kB
          Chen Liang
        9. HDFS-12979.009.patch
          21 kB
          Chen Liang
        10. HDFS-12979.010.patch
          21 kB
          Chen Liang
        11. HDFS-12979.011.patch
          21 kB
          Chen Liang
        12. HDFS-12979.012.patch
          22 kB
          Chen Liang
        13. HDFS-12979.013.patch
          23 kB
          Chen Liang
        14. HDFS-12979.014.patch
          24 kB
          Chen Liang
        15. HDFS-12979.015.patch
          24 kB
          Chen Liang
        16. HDFS-12979-branch-2.001.patch
          24 kB
          Chen Liang

        Issue Links

          Blocked

          Bug - A problem which impairs or prevents the functions of the product. HDFS-15562 StandbyCheckpointer will do checkpoint repeatedly while connecting observer/active namenode failed

          • Major - Major loss of function.
          • Patch Available
          breaks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-15287 HDFS rollingupgrade prepare never finishes

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vagarychen Chen Liang
              shv Konstantin Shvachko
              Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: