Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-8437

RecordReader 'Infer Schema' for large records with JsonPathReader may throw IOException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.12.1
    • 1.14.0
    • Core Framework
    • Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB storage

    Description

      In the RecordReader(s), if the Schema Access Strategy is set to Infer Schema and the record is a single large record(tested with record ~50MB), the InferSchemaAccessStrategy will error.

      Attachments

        1. PDF_Encode_Decode_template-with-bug.xml
          62 kB
          Matthew Lannan
        2. Nifi-stack-trace.txt
          3 kB
          Matthew Lannan

        Issue Links

          Activity

            People

              denes Denes Arvay
              lannanml Matthew Lannan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h