Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1509

Resync discarded directories in fs.name.dir during saveNamespace command

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In the current implementation, if the Namenode encounters an error while writing to a fs.name.dir directory it stops writing new edits to that directory. My proposal is to make the namenode write the fsimage to all configured directories in fs.name.dir, and from then on, continue writing fsedits to all configured directories.

      1. resyncBadNameDir3.txt
        8 kB
        dhruba borthakur
      2. resyncBadNameDir2.txt
        7 kB
        dhruba borthakur
      3. resyncBadNameDir1.txt
        9 kB
        dhruba borthakur

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              dhruba borthakur
              Reporter:
              dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development