Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14890

Setting permissions on name directory fails on non posix compliant filesystems

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.2.1
    • Fix Version/s: 3.3.0, 3.1.4, 3.2.2
    • Component/s: None
    • Labels:
      None
    • Environment:

      Windows 10.

    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      - Fixed namenode/journal startup on Windows.

      Description

      Hi,

      HDFS NameNode and JournalNode are not starting in Windows machine. Found below related exception in logs. 

      Caused by: java.lang.UnsupportedOperationExceptionCaused by: java.lang.UnsupportedOperationException
      at java.base/java.nio.file.Files.setPosixFilePermissions(Files.java:2155)
      at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:452)
      at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:591)
      at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:613)
      at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:188)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1206)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:422)
      at com.slog.dfs.hdfs.nn.NameNodeServiceImpl.delayedStart(NameNodeServiceImpl.java:147)

       

      Code changes related to this issue: https://github.com/apache/hadoop/commit/07e3cf952eac9e47e7bd5e195b0f9fc28c468313#diff-1a56e69d50f21b059637cfcbf1d23f11

       

        Attachments

        1. HDFS-14890.01.patch
          1 kB
          Siddharth Wagle

          Issue Links

            Activity

              People

              • Assignee:
                swagle Siddharth Wagle
                Reporter:
                hirik hirik
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: