Hadoop Common
  1. Hadoop Common
  2. HADOOP-8136

Enhance hadoop to use a newer version (0.8.1) of the jets3t library

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: 1.0.0, 0.22.0, 0.23.3
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None
    • Environment:

      Ubuntu 11.04, 64 bit, JDK 1.6.0_30

    • Target Version/s:

      Description

      Hadoop is built against, and includes, an older version of the Jets3t library - version 0.6.1.
      The current version of the Jets3t library(as of March 2012) is 0.8.1. This new version includes many improvements such as support for "Requester-Pays" buckets.

      Since hadoop includes a copy of the version 0.6.1 jets3t library, and since this version ends up early in the CLASSPATH, any Map Reduce application that wants to use the jets3t library ends up getting version 0.6.1 of the jets3t library. The MR application fails, usually with an error stating that the method signature of some method in the Jets3t library does not match.

      It would be useful to enhance Jets3tNativeFileSystemStore.java to use the API published by the 0.8.1 version of the jets3t library.

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Unassigned
              Reporter:
              Jagane Sundar
            • Votes:
              3 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Development