[NIFI-6496] Add compression support to record reader processor

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Extensions
• Labels: easyfix usability
• Assignee: Unassigned
• Reporter: Malthe Borch
• Created: 29/Jul/19 07:21
• Updated: 07/Jul/23 15:42

Description

Text-based record formats such as CSV, JSON and XML compress well and will often be transmitted in a compressed format. If compression support is added to the relevant processors, users will not need to explicitly unpack files before processing (which may not be feasible or practical due to space requirements).

There are at least two ways of implementing this, using either a generic approach where a CompressedRecordReaderFactory is the basis for a new controller service that wraps the underlying record reader controller service (e.g. CSVReader); or adding the functionality at the relevant record reader implementations.

The latter option may provide a better UX because no additional ControllerService has to be configured.