Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-15990

S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.2.0
    • Fix Version/s: None
    • Component/s: fs/s3
    • Labels:
      None
    • Target Version/s:

      Description

      in S3AFileSystem.initialize(), we check for the bucket existing with verifyBucketExists(), which calls s3.doesBucketExist(). But that doesn't check for auth issues.

      s3. doesBucketExistV2() does at least validate credentials, and should be switched to. This will help things fail faster

      See SPARK-24000

      (this is a dupe of HADOOP-15409; moving off git PRs so we can get yetus to test everything)

        Attachments

        1. HADOOP-15990-006.patch
          6 kB
          lqjacklee
        2. HADOOP-15409-005.patch
          0.9 kB
          Steve Loughran

          Issue Links

            Activity

              People

              • Assignee:
                Jack-Lee lqjacklee
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: