Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5483

Make Integration Tests Work With Large Flow Files

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.7.1
    • None
    • Tools and Build
    • None

    Description

      It seems, at it's current state, integration tests do not work with very large files (such as over 2 GB). I believe this stems from the fact that MockFlowFile uses a byte array to to copy data and a byte array can not hold over 2147483647 bytes. For things like BigQuery, which supports a 15 terabyte payload, testing becomes difficult.

      Attachments

        Activity

          People

            Unassigned Unassigned
            danieljimenez Daniel
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: