Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7537

fsck is confusing when dfs.namenode.replication.min > 1 && missing replicas && NN restart

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • namenode
    • None
    • Reviewed

    Description

      If minimum replication is set to 2 or higher and some of those replicas are missing and the namenode restarts, it isn't always obvious that the missing replicas are the reason why the namenode isn't leaving safemode. We should improve the output of fsck and the web UI to make it obvious that the missing blocks are from unmet replicas vs. completely/totally missing.

      Attachments

        1. dfs-min-2.png
          27 kB
          Allen Wittenauer
        2. dfs-min-2-fsck.png
          12 kB
          Allen Wittenauer
        3. HDFS-7537.1.patch
          3 kB
          Rui Gao
        4. HDFS-7537.2.patch
          7 kB
          Rui Gao
        5. Screen Shot 2015-02-26 at 10.27.46.png
          128 kB
          Rui Gao
        6. Screen Shot 2015-02-26 at 10.30.35.png
          85 kB
          Rui Gao

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8405 Fix a typo in NamenodeFsck

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              demongaorui Rui Gao
              aw Allen Wittenauer
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: