[HDFS-8435] Support CreateFlag in WebHdfs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: webhdfs
• Hadoop Flags: Reviewed
• Assignee: Jakob Homan
• Reporter: Vinoth Sathappan
• Created: 19/May/15 23:50
• Updated: 30/Aug/16 01:33
• Resolved: 19/Aug/15 00:42

Description

The WebHdfsFileSystem implementation doesn't support createNonRecursive. HBase extensively depends on that for proper functioning. Currently, when the region servers are started over web hdfs, they crash due with -

createNonRecursive unsupported for this filesystem class org.apache.hadoop.hdfs.web.SWebHdfsFileSystem
at org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:1137)
at org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:1112)
at org.apache.hadoop.fs.FileSystem.createNonRecursive(FileSystem.java:1088)
at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.init(ProtobufLogWriter.java:85)
at org.apache.hadoop.hbase.regionserver.wal.HLogFactory.createWriter(HLogFactory.java:198)

Issue Links

• breaks: HDFS-10684 WebHDFS DataNode calls fail without parameter createparent