[NIFI-2048] ExecuteSQL converts BigDecimal to strings in Avro

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 0.6.1
• Fix Version/s: 1.3.0
• Assignee: Unassigned
• Reporter: Bryan Bende
• Created: 17/Jun/16 17:08
• Updated: 08/Aug/17 18:40
• Resolved: 08/Aug/17 18:40

Description

Some JDBC drivers (Oracle is one of them) return NUMBER columns as BigDecimal. NiFi then turns that into a string in the Avro that is produced.

This happens in JdbcCommon when creating the schema:

        
case DECIMAL:
case NUMERIC:            
builder.name(meta.getColumnName(i)).type().unionOf()
  .nullBuilder().endNull().and().stringType().endUnion().noDefault();

Then later when getting the value of the column to add to the Avro record:

} else if (value instanceof BigDecimal || value instanceof BigInteger) {
                        rec.put(i - 1, value.toString());
                    } 

It looks like Avro has support for Decimal types and we should look into using this:

https://avro.apache.org/docs/1.7.7/spec.html#Logical+Types
https://issues.apache.org/jira/browse/AVRO-1402

Issue Links

• is duplicated by: NIFI-2624 JDBC-to-Avro processors handle BigDecimals as Strings