Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-884

DataNode makeInstance should report the directory list when failing to start up

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.22.0
    • 0.22.0
    • datanode
    • None
    • Reviewed

    Description

      When Datanode.makeInstance() cannot work with one of the directories in dfs.data.dir, it logs this at warn level (while losing the stack trace).

      It should include the nested exception for better troubleshooting. Then, when all dirs in the list fail, an exception is thrown, but this exception does not include the list of directories. It should list the absolute path of every missing/failing directory, so that whoever sees the exception can see where to start looking for problems: either the filesystem or the configuration.

      Attachments

        1. HDFS-884.patch
          1 kB
          Steve Loughran
        2. HDFS-884.patch
          2 kB
          Steve Loughran
        3. InvalidDirs.patch
          2 kB
          Konstantin Shvachko
        4. InvalidDirs.patch
          3 kB
          Konstantin Shvachko
        5. InvalidDirs.patch
          3 kB
          Konstantin Shvachko

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: