[STREAMPIPES-523] Enable connect adapter service development when core runs in Docker

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.0.0
• Component/s: Pipeline Elements
• Assignee: Unassigned
• Reporter: Patrick Wiener
• Created: 31/Mar/22 12:01
• Updated: 26/Nov/22 15:17

Description

Opposed to processors and sinks that are passively registered by the core of StreamPipes via the service discovery feature in Consul, connect adapter services actively register their service description at the core service. Therefore, the URL of the core is retrieved via Consul which points to the core container IP address (commonly "http://172.x.x.x:8030") which can't be resolved from the local IDE environment.

Option A

Adapter developers can manipulate the docker-compose description of the backend service by adding an "SP_HOST" environment variable with their local machine's IP address. Thereby, the core of StreamPipes registers under this IP at Consul which can be resolved from the local IDE, e.g., with the URL "http://192.x.x.x:8030".

Option B

Adapter developers can simply use the "SP_DEBUG=true" environment variable in the run configuration of a connect adapter service to remap the retrieved URL from "http://172.x.x.x:8030" to "http://localhost:8030". 

 

Note: this allows applies for hybrid service definitions containing, e.g., extensions-all-jvm, as it contains adapter services that currently try to actively register at the core.