[NIFI-5572] Support decimal as a RecordFieldType

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: Core Framework
• Assignee: Unassigned
• Reporter: Gideon Korir
• Created: 04/Sep/18 08:59
• Updated: 18/May/21 00:08

Description

I'm building a custom RecordReader to import financial data from extracts in a custom file format. Everything works except when converting from Avro Schema to RecordSchema, the decimal information is silently converted to double causing the reader to interpret the transaction values as doubles.

It would be nice if we had native support for Decimals as now I have to read the values as string and then run a spark job to convert them to doubles.

My suggestion would be:

1. Add a RecordFieldType.DECIMAL value
2. Add a DecimalDataType class that has `getPrecision()` and `getScale()` getters
3. Add a `RecordFieldType.getDecimalDataType(precision, scale)` method to create an instance of the RecordFieldType.DECIMAL value

Issue Links

• links to: GitHub Pull Request #3343
• links to: GitHub Pull Request #3343