[NIFI-11167] Add Excel Record Reader

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.0-M1, 1.23.0
• Component/s: Extensions
• Assignee: Daniel Stieglitz
• Reporter: David Handermann
• Created: 10/Feb/23 17:59
• Updated: 26/Mar/24 18:48
• Resolved: 16/Jun/23 21:10

Description

A new Excel Record Reader should be implemented to support reading XSLX spreadsheet rows as NiFi Records. This Reader will enable integration with various record-oriented components, obviating the need for the narrowly focused ConvertExcelToCSVProcessor. The initial version of the Excel Reader should not support the legacy binary XLS format.

The ExcelReader should use a library that supports reading from a stream of rows to avoid consuming large amounts of heap memory during processing.

The ExcelReader should support configurable properties to read selected sheets. With Excel supporting typed field values, some amount of field type mapping will be required. Additional input filtering properties should not be implemented as existing Processors like QueryRecord support a wide variety of filtering and projection use cases.

Issue Links

• causes: NIFI-12510 Excel Record Reader | Extend Functionality
• is a parent of: NIFI-12491 Add Use Starting Row Strategy to Excel Reader
• is a parent of: NIFI-12410 ExcelReader - Starting Row should have flowfile attributes scope
• is related to: NIFI-11716 Backport nifi-schema-inference-utils to support branch
• relates to: NIFI-4309 ConvertExcelToCSVProcessor converting Time strings to decimals
• relates to: NIFI-10792 ConvertExcelToCSVProcessor : Failed to convert file over 10MB
• relates to: NIFI-8534 ConvertExcelToCSVProcessor outputting 0-byte files
• relates to: NIFI-11787 Add property to configure Min Inflate Ratio in ConvertExcelToCSVProcessor
• links to: GitHub Pull Request #7194