[HADOOP-3518] Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem

• Type: Wish
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: fs
• Assignee: Unassigned
• Reporter: Thomas White
• Created: 09/Jun/08 10:33
• Updated: 27/Apr/16 13:33

Description

JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for interacting with files and file systems (as well as other NIO enhancements). It is scheduled to be released as a part of Java 7.

This motivation behind this issue is to see if NIO.2 can be used as an interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving Hadoop developers an opportunity to influence NIO's design (if necessary). Also, learning more about NIO.2 may inform design decisions for Hadoop filesystems.

The starting point for this work should be the java.nio.file.spi package (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). There is an example of a filesystem provider (for ZIP files) linked from the OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also has other useful links, such as a JavaOne talk, javadoc and source code.

Issue Links

• relates to: HADOOP-9590 Move to JDK7 improved APIs for file operations when available
• relates to: HDFS-916 Rewrite DFSOutputStream to use a single thread with NIO