Uploaded image for project: 'Apache Hop'
  1. Apache Hop
  2. HOP-2567

Allow output rows from any transform to be streamed to another pipeline

    XMLWordPrintableJSON

Details

    Description

      This is the same principle as the pipeline and workflow log metadata types.

      In this case we want to have the ability to flag a series of transforms which all need to stream their data to a specified transform.

      Since in general the transforms would output different values we'd do best to normalize the data before handing it over.

      Here are some fields we could stream:

      • sourcePipeline (String)
      • sourceTransformName (String)
      • sourceTransformCopy (Integer)
      • fieldName (String)
      • fieldType (String)
      • fieldFormat (String)
      • fieldLength (Integer)
      • fieldPrecision (Integer)
      • value (String)

      We would want to have the ability to select and de-select a "Pipeline Probe" by clicking on a transform.

      Once a probe is selected you should see some visual indicator.

      In the Pipeline Probe metadata objects we should see a list of all the pipelines and transforms where data is captured.  

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              mcasters Matt Casters
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m