With AWS SDK upgrade to 1.11.655, we strongly encourage the users that use S3N file system (open-source NativeS3FileSystem that is based on jets3t library) on Hadoop 2.7.3 to upgrade to use AWS Signature V4 and set the bucket endpoint or migrate to S3A (“s3a://” prefix) - jets3t library uses AWS v2 by default and s3.amazonaws.com as an endpoint. Otherwise, the 403 Forbidden error may be thrown in the following cases:
If a user accesses an S3 path that contains “+” characters and uses the legacy S3N file system, e.g.
s3n://bucket/path/+file.
If a user has configured AWS V2 signature to sign requests to S3 with S3N file system.
Note that if you use S3AFileSystem, e.g. (“
s3a://bucket/path”) to access S3 in S3Select or SQS connectors, then everything will work as expected.
Bug
Minor
Dongjoon Hyun