Logging a JIRA to track and discuss upgrading Drill's Hadoop dependency version. Currently Drill depends on Hadoop 2.5.0 version. Newer version of Hadoop (2.7.1) has following features.
1) Better S3 support
2) Ability to check if a user has certain permissions on file/directory without performing operations on the file/dir. Useful for cases like
As Drill is going to use higher version of Hadoop fileclient, there could be potential issues when interacting with Hadoop services (such as HDFS) of lower version than the fileclient.