Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
2.1.2
-
None
Description
HDFS allows the ability to tag DataNode data directories with meta information:
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html
Which results in paths that look like:
[DISK]/hadoop/hdfs/data,[SSD]/hadoop/hdfs/ssd
Many of our scripts assume that directories specified in hdfs-site/dfs.datanode.data.dir are actual paths and perform operations like os.path.isdir which will fail with meta data.
Attachments
Attachments
Issue Links
- links to