Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-979

FSImage should specify which dirs are missing when refusing to come up

    Details

    • Type: Improvement Improvement
    • Status: Patch Available
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.22.0
    • Fix Version/s: None
    • Component/s: namenode
    • Labels:
      None
    • Release Note:
      Added more verbose error logging in FSImage should there be an issue getting the size of the NameNode data or edits directories.

      Description

      When FSImage can't come up as either it has no data or edit dirs, it tells me this

      java.io.IOException: All specified directories are not accessible or do not exist.
      

      What it doesn't do is say which of the two attributes are missing. This would be beneficial to anyone trying to track down the problem. Also, I don't think the message is correct. It's bailing out because dataDirs.size() == 0 || editsDirs.size() == 0 , because a list is empty -not because the dirs aren't there, as there hasn't been any validation yet.

      More useful would be

      1. Explicit mention of which attributes are null
      2. Declare that this is because they are not in the config
      1. HDFS-979-take1.txt
        5 kB
        Jim Plush
      2. HDFS-979-take2.txt
        5 kB
        Jim Plush
      3. HDFS-979-take3.txt
        5 kB
        Jim Plush

        Activity

        steve_l created issue -
        Gavin made changes -
        Field Original Value New Value
        Reporter Steve Loughran [ steve_l ] Steve Loughran [ stevel@apache.org ]
        Jim Plush made changes -
        Attachment HDFS-979-take1.txt [ 12483878 ]
        Jim Plush made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note Added more verbose error logging in FSImage should there be an issue getting the size of the NameNode data or edits directories.
        Assignee Jim Plush [ jimplush ]
        Fix Version/s 0.23.0 [ 12315571 ]
        Jim Plush made changes -
        Attachment HDFS-979-take2.txt [ 12483882 ]
        Jim Plush made changes -
        Attachment HDFS-979-take3.txt [ 12484010 ]
        Arun C Murthy made changes -
        Fix Version/s 0.24.0 [ 12317653 ]
        Fix Version/s 0.23.0 [ 12315571 ]
        Allen Wittenauer made changes -
        Fix Version/s 0.24.0 [ 12317653 ]

          People

          • Assignee:
            Jim Plush
            Reporter:
            Steve Loughran
          • Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:

              Development