[NIFI-8237] PutDatabaseRecord can not insert into mysql table with TEXT column

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.14.0, 1.13.1
• Component/s: Extensions

Environment

Linux hb3-prod-gem-svc1-001 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

openjdk version "1.8.0_282"
OpenJDK Runtime Environment (build 1.8.0_282-b08)
OpenJDK 64-Bit Server VM (build 25.282-b08, mixed mode)

• Assignee: Matt Burgess
• Reporter: macdoor615
• Created: 18/Feb/21 17:02
• Updated: 25/Feb/21 05:57
• Resolved: 23/Feb/21 15:08

Description

1. create table on mysql server

CREATE TABLE tmp_text (
 ver varchar(10) NULL,
 richtext text NULL
 ) ;

2. insert data into table with PutDatabaseRecord processor , raise error

2021-02-19 00:43:04,424 ERROR [Timer-Driven Process Thread-3] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=b54f68de-0177-1000-917a-119d1bd6f5bf] Failed to put Records to database for StandardFlowFileRecord[uuid=3ad1b100-5661-4988-a21b-795b24cc5222,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1613666502360-8, container=default, section=8], offset=87073, length=17],offset=0,name=3ad1b100-5661-4988-a21b-795b24cc5222,size=17]. Routing to failure.: java.lang.NullPointerException
java.lang.NullPointerException: null
at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:181)
at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:152)
at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:148)
at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:707)
at org.apache.nifi.processors.standard.PutDatabaseRecord.putToDatabase(PutDatabaseRecord.java:838)
at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:487)
at org.pache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1173)
at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

 

3. downgrade to Nifi 1.12.1, no error, data inserted into table

4. change TEXT column to VARCHAR, no error

 

Issue Links

• duplicates: NIFI-8244 PutDatabaseRecord incorrect type resolution for partial columns
• is caused by: NIFI-8223 PutDatabaseRecord should use table column datatype instead of field datatype
• links to: GitHub Pull Request #4835