[NIFI-8393] PutDatabaseRecord PostgreSQL JSON column order invalid type inference

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.13.0, 1.13.1, 1.13.2
• Component/s: Core Framework
• Assignee: Unassigned
• Reporter: Dorian Bugeja
• Created: 03/Apr/21 03:56
• Updated: 03/Apr/21 03:57

Description

Hi,

I'm having some weird behaviour with PutDatabaseRecord 1.13.2 connecting to PostgreSQL 13.2. When I try to insert a new record containing a datetime, I'm getting a column type mismatch as it's seen varying character (the datatype in the debug output is 97). The weird part is that there are instances where the file is successfully submitted as seen in screenshot 2. In screenshot 1, I'm able to insert the row success when using ExecuteSQLRecord (and ExecuteSQL) for the one that failed. I think this is related to an issue I've opened earlier NIFI-8244 however I'm not sure if they are the same. Screenshot 3 shows the structure of my table while screenshot 4 shows the inferred dataTypes. Please find attached also a nifi_order_issue.json showing 3 sample files, 1 failed, 2 successful, 3 is 1 reordered and succesful)

JDBC Driver being used = https://jdbc.postgresql.org/download/postgresql-42.2.12.jar

The controllers were all to Infer schema

 

 

Screenshot 2)

Screenshot 3)

Screenshot 4)