[NIFI-8077] ConvertRecord Json to Avro with empty array

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.12.1
• Component/s: Core Framework
• Environment: 18.04.1-Ubuntu
• Assignee: Unassigned
• Reporter: hipotures
• Created: 07/Dec/20 17:27
• Updated: 07/Dec/20 17:27

Description

ConvertRecord processor with settings
   Record Reader: JsonTreeReader (with Infer Schema)
   Record Writer: AvroRecordSetWriter (with Embed Avro Schema)

Error:

PutBigQueryBatch[id=dc0f47e9-0175-1000-f086-85c2c62eea10] Provided Schema does not match Table nfz_agreements.agreement. Field plans has changed type from RECORD to STRING

First source JSON (part):

(...)
"plans":[
 {
 "id":"8abb0ba3-f0e5-4720-70d3-bfef74c16932",
 "type":"agreement-plan",
 "attributes":{
 "product_code":"02.0000.078.02",
 "product_name":"BADANIA ENDOSKOPOWE PRZEWODU POKARMOWEGO - GASTROSKOPIA",
 "order":1,
 "unit_count":167430.0,
 "price":155709.9,
 "avg_price":0.93
 },
 "links":{
 "related":"https://api.nfz.gov.pl/app-umw-api/plans/8abb0ba3-f0e5-4720-70d3-bfef74c16932?format=json"
 }
 }
],
(...)

 

Second source JSON (part):

(...)
"plans" : [ ],
(...)