Uploaded image for project: 'Apache Hop (incubating)'
  1. Apache Hop (incubating)
  2. HOP-2567

Allow output rows from any transform to be streamed to another pipeline

    XMLWordPrintableJSON

    Details

      Description

      This is the same principle as the pipeline and workflow log metadata types.

      In this case we want to have the ability to flag a series of transforms which all need to stream their data to a specified transform.

      Since in general the transforms would output different values we'd do best to normalize the data before handing it over.

      Here are some fields we could stream:

      • sourcePipeline (String)
      • sourceTransformName (String)
      • sourceTransformCopy (Integer)
      • fieldName (String)
      • fieldType (String)
      • fieldFormat (String)
      • fieldLength (Integer)
      • fieldPrecision (Integer)
      • value (String)

      We would want to have the ability to select and de-select a "Pipeline Probe" by clicking on a transform.

      Once a probe is selected you should see some visual indicator.

      In the Pipeline Probe metadata objects we should see a list of all the pipelines and transforms where data is captured.  

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                mcasters Matt Casters
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m