Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11112

Journal Nodes should refuse to format non-empty directories

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha4
    • None
    • None
    • Reviewed

    Description

      Journal Nodes should reject the format RPC request if a storage directory is non-empty. The relevant code is in JNStorage#format.

        void format(NamespaceInfo nsInfo) throws IOException {
    setStorageInfo(nsInfo);
...
    unlockAll();
    sd.clearDirectory();
    writeProperties(sd);
    createPaxosDir();
    analyzeStorage();

      This would make the behavior similar to namenode -format -nonInteractive.

      Attachments

        1. HDFS-11112.001.patch
          3 kB
          Yiqun Lin
        2. HDFS-11112.002.patch
          3 kB
          Yiqun Lin

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-10360 DataNode may format directory and lose blocks if current/VERSION is missing

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDFS-10457 DataNode should not auto-format block pool directory if VERSION is missing

        • Major - Major loss of function.
        • Resolved
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-13805 Journal Nodes should allow to format non-empty directories with "-force" option

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            linyiqun Yiqun Lin
            arp Arpit Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment