Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-884

DataNode makeInstance should report the directory list when failing to start up

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.22.0
    • 0.22.0
    • datanode
    • None
    • Reviewed

    Description

      When Datanode.makeInstance() cannot work with one of the directories in dfs.data.dir, it logs this at warn level (while losing the stack trace).

      It should include the nested exception for better troubleshooting. Then, when all dirs in the list fail, an exception is thrown, but this exception does not include the list of directories. It should list the absolute path of every missing/failing directory, so that whoever sees the exception can see where to start looking for problems: either the filesystem or the configuration.

      Attachments

        1. InvalidDirs.patch
          2 kB
          Konstantin Shvachko
        2. InvalidDirs.patch
          3 kB
          Konstantin Shvachko
        3. InvalidDirs.patch
          3 kB
          Konstantin Shvachko
        4. HDFS-884.patch
          1 kB
          Steve Loughran
        5. HDFS-884.patch
          2 kB
          Steve Loughran

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stevel@apache.org Steve Loughran
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment