[BEAM-7579] Tests fail with "Cannot create a default bucket when --dataflowKmsKey is set."

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 2.13.0
• Fix Version/s: Not applicable
• Component/s: io-java-gcp
• Assignee: Udi Meiri
• Reporter: Luke Cwik
• Created: 17/Jun/19 18:09
• Updated: 16/May/20 14:04
• Resolved: 19/Jun/19 16:51

Description

Example run: https://builds.apache.org/job/beam_PostCommit_Java/3535/

Failing tests:

org.apache.beam.sdk.io.gcp.storage.GcsKmsKeyIT.testGcsWriteWithKmsKey
org.apache.beam.sdk.io.gcp.storage.GcsKmsKeyIT.testGcsWriteWithKmsKey
org.apache.beam.sdk.extensions.gcp.util.GcsUtilIT.testRewriteMultiPart

Example trace:

Error Message
java.lang.IllegalArgumentException: Cannot create a default bucket when --dataflowKmsKey is set.
Stacktrace
java.lang.IllegalArgumentException: Cannot create a default bucket when --dataflowKmsKey is set.
	at org.apache.beam.vendor.guava.v20_0.com.google.common.base.Preconditions.checkArgument(Preconditions.java:122)
	at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.tryCreateDefaultBucket(GcpOptions.java:297)
	at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:268)
	at org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:256)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.returnDefaultHelper(ProxyInvocationHandler.java:592)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:533)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:158)
	at com.sun.proxy.$Proxy32.getGcpTempLocation(Unknown Source)
	at org.apache.beam.sdk.io.gcp.storage.GcsKmsKeyIT.testGcsWriteWithKmsKey(GcsKmsKeyIT.java:79)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)

Issue Links

• links to: GitHub Pull Request #8883