[NIFI-8996] PutHive*QL processors do not close JDBC statements

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.4, 1.12.1, 1.14.0, 1.13.2
• Fix Version/s: 1.15.0
• Assignee: Peter Turcsanyi
• Reporter: Peter Turcsanyi
• Created: 04/Aug/21 07:58
• Updated: 05/Aug/21 11:27
• Resolved: 04/Aug/21 13:14

Description

When multiple HiveQL statements arrive in a FlowFile, PutHive*QL processors create and execute the statements in a loop but do not close them. It may lead to data loss.

Example scenario:

• create a source table with 100 Mio records (single int column with random numbers)
• create 10 target tables with the same structure
• feed PutHive3QL with a single FF containing the following script:

truncate table target0;
insert into target0 select * from source;
truncate table target1;
insert into target1 select * from source;
...

• result: some target tables are empty instead of having the 100 Mio records

Issue Links

• links to: GitHub Pull Request #5280