[FLINK-36258] testRecursiveUploadForYarnS3n failed due to no AWS Credentials provided

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Component/s: Deployment / YARN, Tests
• Labels: pull-request-available test-stability
• Assignee: Xuannan Su
• Reporter: Weijie Guo
• Created: 11/Sep/24 09:59
• Updated: 17/Sep/24 11:51
• Resolved: 14/Sep/24 12:42

Description

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=61979&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=995c650b-6573-581c-9ce6-7ad4cc038461&l=28296

Sep 11 05:44:32 Caused by: java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified by setting the fs.s3n.awsAccessKeyId and fs.s3n.awsSecretAccessKey properties (respectively).
Sep 11 05:44:32 	at org.apache.hadoop.fs.s3.S3Credentials.initialize(S3Credentials.java:74)
Sep 11 05:44:32 	at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.initialize(Jets3tNativeFileSystemStore.java:80)
Sep 11 05:44:32 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Sep 11 05:44:32 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Sep 11 05:44:32 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Sep 11 05:44:32 	at java.lang.reflect.Method.invoke(Method.java:498)
Sep 11 05:44:32 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:433)
Sep 11 05:44:32 	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:166)
Sep 11 05:44:32 	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:158)
Sep 11 05:44:32 	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:96)
Sep 11 05:44:32 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:362)
Sep 11 05:44:32 	at org.apache.hadoop.fs.s3native.$Proxy64.initialize(Unknown Source)
Sep 11 05:44:32 	at org.apache.hadoop.fs.s3native.NativeS3FileSystem.initialize(NativeS3FileSystem.java:334)
Sep 11 05:44:32 	at org.apache.flink.runtime.fs.hdfs.HadoopFsFactory.create(HadoopFsFactory.java:168)
Sep 11 05:44:32 	... 33 more

Issue Links

• is caused by: FLINK-34085 Remove deprecated string configuration keys in Flink 2.0
• is duplicated by: FLINK-36272 YarnFileStageTestS3ITCase fails on master
• links to: GitHub Pull Request #25325
• links to: GitHub Pull Request #25328