Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12709

Cut s3:// from trunk



    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 3.0.0-alpha1
    • fs/s3
    • None
    • Incompatible change
    • The s3 file system has been removed. The s3a file system should be used instead.


      UPDATE: This JIRA ticket is to track the effort of cutting the s3:// from trunk branch. Please see the cloned JIRA ticket HADOOP-13239 for deprecating s3:// from branch-2.

      The fact that s3:// was broken in Hadoop 2.7 and nobody noticed until now shows that it's not being used. while invaluable at the time, s3n and especially s3a render it obsolete except for reading existing data.

      I propose

      1. Mark Java source as @deprecated
      2. Warn the first time in a JVM that an S3 instance is created, "deprecated -will be removed in future releases"
      3. in Hadoop trunk we really cut it. Maybe have an attic project (external?) which holds it for anyone who still wants it. Or: retain the code but remove the fs.s3.impl config option, so you have to explicitly add it for use.


        1. HADOOP-12709.000.patch
          119 kB
          Mingliang Liu
        2. HADOOP-12709.001.patch
          146 kB
          Mingliang Liu
        3. HADOOP-12709.002.patch
          147 kB
          Mingliang Liu
        4. HADOOP-12709.003.patch
          168 kB
          Mingliang Liu
        5. HADOOP-12709.004.patch
          172 kB
          Mingliang Liu
        6. HADOOP-12709.005.patch
          172 kB
          Mingliang Liu
        7. HADOOP-12709-006.patch
          179 kB
          Steve Loughran

        Issue Links



              liuml07 Mingliang Liu
              stevel@apache.org Steve Loughran
              0 Vote for this issue
              10 Start watching this issue