[FLINK-6842] Uncomment or remove code in HadoopFileSystem

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Implemented
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.0
• Component/s: Runtime / Task
• Assignee: zhangminglei
• Reporter: Chesnay Schepler
• Created: 02/Jun/17 19:12
• Updated: 07/Jul/17 15:48
• Resolved: 07/Jul/17 15:48

Description

I've found the following code in HadoopFileSystem#getHadoopWrapperClassNameForFileSystem

Configuration hadoopConf = getHadoopConfiguration();
Class<? extends org.apache.hadoop.fs.FileSystem> clazz;
// We can activate this block once we drop Hadoop1 support (only hd2 has the getFileSystemClass-method)
//try {
//	clazz = org.apache.hadoop.fs.FileSystem.getFileSystemClass(scheme, hadoopConf);
//} catch (IOException e) {
//	LOG.info("Flink could not load the Hadoop File system implementation for scheme "+scheme);
//	return null;
//}
clazz = hadoopConf.getClass("fs." + scheme + ".impl", null, org.apache.hadoop.fs.FileSystem.class);

if (clazz != null && LOG.isDebugEnabled()) {
	LOG.debug("Flink supports {} with the Hadoop file system wrapper, impl {}", scheme, clazz);
}
return clazz;

Since we don't support hadoop1 anymore the commented code should either be activated or removed.

Issue Links

• links to: GitHub Pull Request #4219