[DRILL-4063] Missing files/classes needed for S3a access

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.0
• Component/s: Storage - Other
• Labels: aws aws-s3 s3 storage

Environment

All

• Assignee: Abhijit Pol
• Reporter: Nathan Griffith
• Created: 10/Nov/15 21:54
• Updated: 02/Dec/15 17:09
• Resolved: 18/Nov/15 06:16

Description

Specifying

"connection": "s3a://<bucketname>"

results in the following error:

Error: SYSTEM ERROR: ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

I can fix this by dropping in these files from the hadoop binary tarball:
hadoop-aws-2.6.2.jar
aws-java-sdk-1.7.4.jar

And then adding this to my core-site.xml:

  <property>
    <name>fs.s3a.access.key</name>
    <value>ACCESSKEY</value>
  </property>

  <property>
    <name>fs.s3a.secret.key</name>
    <value>SECRETKEY</value>
  </property>