Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8136

Enhance hadoop to use a newer version (0.8.1) of the jets3t library

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.0.0, 0.22.0, 0.23.3
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None
    • Environment:

      Ubuntu 11.04, 64 bit, JDK 1.6.0_30

    • Target Version/s:

      Description

      Hadoop is built against, and includes, an older version of the Jets3t library - version 0.6.1.
      The current version of the Jets3t library(as of March 2012) is 0.8.1. This new version includes many improvements such as support for "Requester-Pays" buckets.

      Since hadoop includes a copy of the version 0.6.1 jets3t library, and since this version ends up early in the CLASSPATH, any Map Reduce application that wants to use the jets3t library ends up getting version 0.6.1 of the jets3t library. The MR application fails, usually with an error stating that the method signature of some method in the Jets3t library does not match.

      It would be useful to enhance Jets3tNativeFileSystemStore.java to use the API published by the 0.8.1 version of the jets3t library.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jagane Jagane Sundar
              • Votes:
                3 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 168h
                  168h
                  Remaining:
                  Remaining Estimate - 168h
                  168h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified