[NIFI-8154] AvroParquetHDFSRecordReader fails to read parquet file containing nested structs

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.11.3, 1.12.1, 1.13.2
• Component/s: Extensions
• Assignee: Lehel Boér
• Reporter: Glenn Jones
• Created: 20/Jan/21 12:02
• Updated: 12/Jun/21 16:09
• Resolved: 09/Jun/21 13:17

Description

FetchParquet can't be used to process files containing nested structs.  When trying to create a RecordSchema it runs into https://issues.apache.org/jira/browse/PARQUET-1441, which causes it to fail.  We've patched this locally by building the nifi-parquet-processors with parquet-avro 1.11.0, but it would be great if this made it into the next release.

Issue Links

• links to: GitHub Pull Request #4769