[NIFI-3724] Add Put/Fetch Parquet Processors

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Assignee: Bryan Bende
• Reporter: Bryan Bende
• Created: 21/Apr/17 13:50
• Updated: 02/Nov/17 20:57
• Resolved: 01/May/17 20:13

Description

Now that we have the record reader/writer services currently in master, it would be nice to have reader and writers for Parquet. Since Parquet's API is based on the Hadoop Path object, and not InputStreams/OutputStreams, we can't really implement direct conversions to and from Parquet in the middle of a flow, but we can we can perform the conversion by taking any record format and writing to a Path as Parquet, or reading Parquet from a Path and writing it out as another record format.

We should add a PutParquet that uses a record reader and writes records to a Path as Parquet, and a FetchParquet that reads Parquet from a path and writes out records to a flow file using a record writer.

Issue Links

• duplicates: NIFI-3612 Add support for Parquet to Nifi-Registry-Bundle
• links to: GitHub Pull Request #1712