[NIFI-10792] ConvertExcelToCSVProcessor : Failed to convert file over 10MB

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.17.0, 1.16.3, 1.18.0
• Fix Version/s: 2.0.0-M1, 1.21.0
• Component/s: Core UI
• Labels: Excel csv processor
• Assignee: Daniel Stieglitz
• Reporter: mayki
• Created: 10/Nov/22 09:44
• Updated: 15/Mar/23 22:19
• Resolved: 15/Mar/23 20:29

Description

Hello all,

It seems all version greater 1.15.3 introduce a failure on the processor 
ConvertExcelToCSVProcessor with this error :

Tried to allocate an array of length 101,695,141, but the maximum length for this record type is 100,000,000. If the file is not corrupt or large, please open an issue on bugzilla to request increasing the maximum allowable size for this record type. As a temporary workaround, consider setting a higher override value with IOUtils.setByteArrayMaxOverride() 

I have tested with 2 differences instances nifi version 1.15.3 ==> Work: OK
And since upgrade in 1.16, 1.17, 1.18 ==> same processsor failed with file greater than 10MB.

Could you help us to correct this bug ?

Issue Links

• is related to: NIFI-11167 Add Excel Record Reader
• links to: GitHub Pull Request #7016