[HDFS-14890] Setting permissions on name directory fails on non posix compliant filesystems

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.2.1
• Fix Version/s: 3.3.0, 3.1.4, 3.2.2

Environment

Windows 10.

• Target Version/s: 3.3.0, 3.2.2
• Hadoop Flags: Reviewed
• Release Note: - Fixed namenode/journal startup on Windows.
• Assignee: Siddharth Wagle
• Reporter: hirik
• Created: 03/Oct/19 16:49
• Updated: 15/Oct/19 18:45
• Resolved: 15/Oct/19 18:44

Description

Hi,

HDFS NameNode and JournalNode are not starting in Windows machine. Found below related exception in logs. 

Caused by: java.lang.UnsupportedOperationExceptionCaused by: java.lang.UnsupportedOperationException
at java.base/java.nio.file.Files.setPosixFilePermissions(Files.java:2155)
at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:452)
at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:591)
at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:613)
at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:188)
at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1206)
at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:422)
at com.slog.dfs.hdfs.nn.NameNodeServiceImpl.delayedStart(NameNodeServiceImpl.java:147)

 

Code changes related to this issue: https://github.com/apache/hadoop/commit/07e3cf952eac9e47e7bd5e195b0f9fc28c468313#diff-1a56e69d50f21b059637cfcbf1d23f11

 

Issue Links

• is related to: HDFS-2470 NN should automatically set permissions on dfs.namenode.*.dir