Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
2.0.0-alpha
-
None
-
None
-
Reviewed
Description
I misconfigured the permissions of the DataNode data directories (they were owned by root, instead of hdfs).
I wasn't aware of this misconfiguration until a few days later. I usually search through the logs for WARN and ERROR but didn't find messages at these levels that indicated volume failure.
After more carefully reading the logs, I found:
2012-10-01 13:07:10,440 INFO org.apache.hadoop.hdfs.server.common.Storage: Cannot access storage directory /data/4/dfs/dn 2012-10-01 13:07:10,440 INFO org.apache.hadoop.hdfs.server.common.Storage: Storage directory /data/4/dfs/dn does not exist.
I think we should bump the log level to ERROR. This will make the problem more visible to users.