[BEAM-12510] POM files with direct reference to maven repositories

• Type: Bug
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Affects Version/s: 2.30.0
• Component/s: build-system, dependencies, io-java-kafka
• Assignee: Unassigned
• Reporter: Abel Matos
• Created: 18/Jun/21 13:36
• Updated: 4 days ago 07:50

Description

Issue: 
I'm working on a company that only allow private maven repositories ( like nexus internal proxies ) .
I'm starting to see a public repository been called on my builds 

 [ERROR] Failed to execute goal on project pipeline-app: Could not resolve dependencies for project com.equifax.dfds.platform:pipeline-app:jar:20210618.2.ae73898: Failed to collect dependencies at org.apache.beam:beam-runners-google-cloud-dataflow-java:jar:2.30.0 -> org.apache.beam:beam-sdks-java-io-kafka:jar:2.30.0 -> io.confluent:kafka-avro-serializer:jar:5.3.2: Failed to read artifact descriptor for io.confluent:kafka-avro-serializer:jar:5.3.2: Could not transfer artifact io.confluent:kafka-avro-serializer:pom:5.3.2 from/to io.confluent (https://packages.confluent.io/maven/): Connection reset -> [Help 1]
 org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project pipeline-app: Could not resolve dependencies for project com.equifax.dfds.platform:pipeline-app:jar:20210618.2.ae73898: Failed to collect dependencies at org.apache.beam:beam-runners-google-cloud-dataflow-java:jar:2.30.0 -> org.apache.beam:beam-sdks-java-io-kafka:jar:2.30.0 -> io.confluent:kafka-avro-serializer:jar:5.3.2

Has part of the ticket, a repository has been added directly to the generated pom. 
This repository should be configured by users that want to compile the code... not pre-configured/ forced on the pom file. 

https://issues.apache.org/jira/browse/BEAM-9292

Now exit this element on the pom 

<repositories>
  <repository>
    <id>io.confluent</id>
    <url>https://packages.confluent.io/maven/</url>
  </repository>
</repositories>

https://repo1.maven.org/maven2/org/apache/beam/beam-sdks-java-io-kafka/2.30.0/beam-sdks-java-io-kafka-2.30.0.pom
VS 
https://repo1.maven.org/maven2/org/apache/beam/beam-sdks-java-io-kafka/2.19.0/beam-sdks-java-io-kafka-2.19.0.pom

 

dependencies added here 

https://github.com/apache/beam/commit/f2cc92663ad8ae685183e076cdb652d8fc3ba4e0