[HOP-4211] REST client not working in hop2.0 and hop 2.1 SNAPSHOT

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.1.0
• Fix Version/s: 2.1.0
• Component/s: Transforms
• Labels: pull-request-available
• Environment: Windows 10 + jdk-11.0.16.8-hotspot ; Ubuntu + java-11-openjdk-amd64
• Assignee: Hans Van Akelyen
• Reporter: Richard Caplin
• Created: 15/Sep/22 17:27
• Updated: 20/Sep/22 10:58
• Resolved: 16/Sep/22 13:31

Description

A pipeline containing the REST client transform runs without issue in hop v1.2.

The same pipeline running under the same project configuration (no environment used) fails with java errors in hop 2.0 and hop2.1 snapshot (hop-client-2.1.0-20220914.163440-1)

Issue occurs in both Windows and Linux.

Java:   

Win:   jdk-11.0.16.8-hotspot

Linux:    java-11-openjdk-amd64

IN HOP2.0

ERROR: Because of an error, this transform can't continue:
 Can not result from https://<....valid URL....>/10?search=Status%20eq%201
 java.net.UnknownHostException: <....valid host....>
 ERROR: org.apache.hop.core.exception.HopException:
 Can not result from https://<....valid URL....>/10?search=Status%20eq%201
 java.net.UnknownHostException: <....valid host....>
          at org.apache.hop.pipeline.transforms.rest.Rest.callRest(Rest.java:284)
          at org.apache.hop.pipeline.transforms.rest.Rest.processRow(Rest.java:513)
          at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:51)
          at java.base/java.lang.Thread.run(Thread.java:829)
 Caused by: com.sun.jersey.api.client.ClientHandlerException: java.net.UnknownHostException: <....valid host....>
          at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155)
          at com.sun.jersey.api.client.Client.handle(Client.java:652)
          at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)
          at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
          at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509)
          at org.apache.hop.pipeline.transforms.rest.Rest.callRest(Rest.java:183)
          ... 3 more
 Caused by: java.net.UnknownHostException: <....valid host....>
          at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:229)
          at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
          at java.base/java.net.Socket.connect(Socket.java:609)
          at java.base/sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:305)
          at java.base/sun.security.ssl.BaseSSLSocketImpl.connect(BaseSSLSocketImpl.java:173)
          at java.base/sun.net.NetworkClient.doConnect(NetworkClient.java:182)
          at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:508)
          at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:603)
          at java.base/sun.net.www.protocol.https.HttpsClient.<init>(HttpsClient.java:266)
          at java.base/sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:373)
          at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:207)
          at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1187)
          at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1081)
          at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:193)
          at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1592)
          at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
          at java.base/java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:527)
          at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:334)
          at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253)
          at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153)
          ... 8 more

IN HOP 2.10 SNAPSHOT

022/09/15 17:30:33 - test_REST-client - Initialising 5 transforms...
2022/09/15 17:30:33 - Lookup Campaign Status.0 - ERROR: Error setting configuration
2022/09/15 17:30:33 - Lookup Campaign Status.0 - ERROR: java.lang.UnsupportedOperationException
2022/09/15 17:30:33 - Lookup Campaign Status.0 - at java.base/java.util.Collections$UnmodifiableMap.put(Collections.java:1457)
2022/09/15 17:30:33 - Lookup Campaign Status.0 - at org.apache.hop.pipeline.transforms.rest.Rest.setConfig(Rest.java:290)
2022/09/15 17:30:33 - Lookup Campaign Status.0 - at org.apache.hop.pipeline.transforms.rest.Rest.init(Rest.java:559)
2022/09/15 17:30:33 - Lookup Campaign Status.0 - at org.apache.hop.pipeline.transform.TransformInitThread.run(TransformInitThread.java:66)
2022/09/15 17:30:33 - Lookup Campaign Status.0 - at java.base/java.lang.Thread.run(Thread.java:829)
2022/09/15 17:30:33 - Lookup Campaign Status.0 - ERROR: Error initializing transform [Lookup Campaign Status]
2022/09/15 17:30:33 - test_REST-client - Transform [Add constants.0] initialized flawlessly.
2022/09/15 17:30:33 - test_REST-client - Transform [Get variables.0] initialized flawlessly.
2022/09/15 17:30:33 - test_REST-client - Transform [Generate rows.0] initialized flawlessly.
2022/09/15 17:30:33 - test_REST-client - ERROR: Transform [Lookup Campaign Status.0] failed to initialize!
2022/09/15 17:30:33 - test_REST-client - Transform [Dummy (do nothing).0] initialized flawlessly.
2022/09/15 17:30:33 - Hop - ERROR: test_REST-client: preparing pipeline execution failed

Issue Links

• links to: GitHub Pull Request #1684