Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-8968

Improve throughput performance for InvokeHTTP

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.14.0
    • None
    • None
    • None

    Description

      InvokeHTTP is the preferred processor to use over the deprecated PostHTTP. However, PostHTTP outperforms InvokeHTTP (at least in POST mode). A template and a JSON file have been attached to this ticket for benchmarking the two processors. Using this flow, PostHTTP was observed to have a throughput of approximately 5 times greater than InvokeHTTP.

      In addition, it was noted that InvokeHTTP had approximately 5 times as many tasks and 5 times the task duration for a given 5 minute stats window. And, the statistics of Bytes Read and Bytes Transferred remain at zero for InvokeHTTP; this area accurate statistics also needs to be addressed.

      Attachments

        1. Compare_Invoke_PostHTTP.json
          36 kB
          Mark Bean
        2. ListenHTTP-BytesOut.PNG
          67 kB
          Mark Bean
        3. ListenHTTP-BytesOut-sizeFilter.PNG
          54 kB
          Mark Bean
        4. ListenHTTP-FFOut.PNG
          66 kB
          Mark Bean
        5. ListenHTTP-FFOut-sizeFilter.PNG
          52 kB
          Mark Bean
        6. PostHTTP_vs_InvokeHTTP.json
          42 kB
          Mark Bean
        7. PostHTTP_vs_InvokeHTTP.xml
          84 kB
          Mark Bean

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. NIFI-10163 StandardProcessSession.exportTo() not tracking bytes read

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NIFI-1687 Support sending as a FlowFile in InvokeHTTP

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              markbean Mark Bean
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: