[HADOOP-8136] Enhance hadoop to use a newer version (0.8.1) of the jets3t library

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.0.0, 0.22.0, 0.23.3
• Component/s: fs/s3

Environment

Ubuntu 11.04, 64 bit, JDK 1.6.0_30

• Target Version/s: 1.3.0
• Assignee: Unassigned
• Reporter: Jagane Sundar
• Created: 04/Mar/12 07:38
• Updated: 18/Nov/13 10:08
• Resolved: 18/Nov/13 10:08

Description

Hadoop is built against, and includes, an older version of the Jets3t library - version 0.6.1.
The current version of the Jets3t library(as of March 2012) is 0.8.1. This new version includes many improvements such as support for "Requester-Pays" buckets.

Since hadoop includes a copy of the version 0.6.1 jets3t library, and since this version ends up early in the CLASSPATH, any Map Reduce application that wants to use the jets3t library ends up getting version 0.6.1 of the jets3t library. The MR application fails, usually with an error stating that the method signature of some method in the Jets3t library does not match.

It would be useful to enhance Jets3tNativeFileSystemStore.java to use the API published by the 0.8.1 version of the jets3t library.

Issue Links

• is related to: HADOOP-9623 Update jets3t dependency to 0.9.0
• is superceded by: HADOOP-9454 Support multipart uploads for s3native
• is superceded by: HADOOP-9623 Update jets3t dependency to 0.9.0