Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-884

DataNode makeInstance should report the directory list when failing to start up

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When Datanode.makeInstance() cannot work with one of the directories in dfs.data.dir, it logs this at warn level (while losing the stack trace).

      It should include the nested exception for better troubleshooting. Then, when all dirs in the list fail, an exception is thrown, but this exception does not include the list of directories. It should list the absolute path of every missing/failing directory, so that whoever sees the exception can see where to start looking for problems: either the filesystem or the configuration.

        Attachments

        1. HDFS-884.patch
          1 kB
          Steve Loughran
        2. HDFS-884.patch
          2 kB
          Steve Loughran
        3. InvalidDirs.patch
          2 kB
          Konstantin Shvachko
        4. InvalidDirs.patch
          3 kB
          Konstantin Shvachko
        5. InvalidDirs.patch
          3 kB
          Konstantin Shvachko

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: