This is the same principle as the pipeline and workflow log metadata types.
In this case we want to have the ability to flag a series of transforms which all need to stream their data to a specified transform.
Since in general the transforms would output different values we'd do best to normalize the data before handing it over.
Here are some fields we could stream:
- sourcePipeline (String)
- sourceTransformName (String)
- sourceTransformCopy (Integer)
- fieldName (String)
- fieldType (String)
- fieldFormat (String)
- fieldLength (Integer)
- fieldPrecision (Integer)
- value (String)
We would want to have the ability to select and de-select a "Pipeline Probe" by clicking on a transform.
Once a probe is selected you should see some visual indicator.
In the Pipeline Probe metadata objects we should see a list of all the pipelines and transforms where data is captured.