[HOP-2567] Allow output rows from any transform to be streamed to another pipeline

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.70
• Component/s: Transforms
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Matt Casters
• Created: 25/Feb/21 16:10
• Updated: 28/Feb/21 09:54
• Resolved: 26/Feb/21 12:44

Description

This is the same principle as the pipeline and workflow log metadata types.

In this case we want to have the ability to flag a series of transforms which all need to stream their data to a specified transform.

Since in general the transforms would output different values we'd do best to normalize the data before handing it over.

Here are some fields we could stream:

• sourcePipeline (String)
• sourceTransformName (String)
• sourceTransformCopy (Integer)
• fieldName (String)
• fieldType (String)
• fieldFormat (String)
• fieldLength (Integer)
• fieldPrecision (Integer)
• value (String)

We would want to have the ability to select and de-select a "Pipeline Probe" by clicking on a transform.

Once a probe is selected you should see some visual indicator.

In the Pipeline Probe metadata objects we should see a list of all the pipelines and transforms where data is captured.  

 

Issue Links

• links to: GitHub Pull Request #647