[NIFI-13315] ListAzureBlobStorage_v12 fails when Record Writer is used

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.27.0, 2.0.0-M4
• Assignee: Peter Turcsanyi
• Reporter: Peter Turcsanyi
• Created: 30/May/24 10:21
• Updated: 27/Jun/24 14:43
• Resolved: 30/May/24 14:08

Description

BlobInfo declares Container Name as type of boolean in the record schema which fails when the records are written.

2024-05-30 12:23:54,794 ERROR [Timer-Driven Process Thread-9] o.a.n.p.a.s.ListAzureBlobStorage_v12 ListAzureBlobStorage_v12[id=dee130d2-d89c-3894-40ba-bc5dd5e52d2b] Failed to write MapRecord[{container=container1, blobName=fea8dfbd-a53c-40f7-ad11-faaefdc7a99c, filename=fea8dfbd-a53c-40f7-ad11-faaefdc7a99c, secondaryUri=null, primaryUri=https://turcsanyiblob.blob.core.windows.net/container1/fea8dfbd-a53c-40f7-ad11-faaefdc7a99c, length=5, language=null, etag=0x8DC3A36EF89F172, lastModified=1709328680000, blobType=BlockBlob, contentType=application/octet-stream}] with reader schema ["blobName" : "STRING", "blobType" : "STRING", "filename" : "STRING", "container" : "BOOLEAN", "length" : "LONG", "lastModified" : "TIMESTAMP:yyyy-MM-dd HH:mm:ss", "etag" : "STRING", "language" : "STRING", "contentType" : "STRING", "primaryUri" : "STRING", "secondaryUri" : "STRING"] and writer schema ["blobName" : "STRING", "blobType" : "STRING", "filename" : "STRING", "container" : "BOOLEAN", "length" : "LONG", "lastModified" : "TIMESTAMP:yyyy-MM-dd HH:mm:ss", "etag" : "STRING", "language" : "STRING", "contentType" : "STRING", "primaryUri" : "STRING", "secondaryUri" : "STRING"] as a JSON Object due to org.apache.nifi.serialization.record.util.IllegalTypeConversionException: Cannot convert value [container1] of type class java.lang.String to Boolean for field container
org.apache.nifi.serialization.record.util.IllegalTypeConversionException: Cannot convert value [container1] of type class java.lang.String to Boolean for field container
    at org.apache.nifi.serialization.record.util.DataTypeUtils.toBoolean(DataTypeUtils.java:1224)
    at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:199)
    at org.apache.nifi.serialization.record.util.DataTypeUtils.convertType(DataTypeUtils.java:178)
    at org.apache.nifi.json.WriteJsonResult.writeValue(WriteJsonResult.java:349)
    at org.apache.nifi.json.WriteJsonResult.writeRecord(WriteJsonResult.java:233)
    at org.apache.nifi.json.WriteJsonResult.writeRecord(WriteJsonResult.java:157)
    at org.apache.nifi.serialization.AbstractRecordSetWriter.write(AbstractRecordSetWriter.java:59)
    at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
    at java.base/java.lang.reflect.Method.invoke(Method.java:580)
    at org.apache.nifi.controller.service.StandardControllerServiceInvocationHandler.invoke(StandardControllerServiceInvocationHandler.java:254)
    at org.apache.nifi.controller.service.StandardControllerServiceInvocationHandler$ProxiedReturnObjectInvocationHandler.invoke(StandardControllerServiceInvocationHandler.java:240)
    at jdk.proxy55/jdk.proxy55.$Proxy220.write(Unknown Source)
    at org.apache.nifi.processor.util.list.AbstractListProcessor.createRecordsForEntities(AbstractListProcessor.java:940)
    at org.apache.nifi.processor.util.list.AbstractListProcessor.listByNoTracking(AbstractListProcessor.java:584)

Issue Links

• fixes: NIFI-7509 Add an optional Record Writer to List* Processors
• links to: GitHub Pull Request #8897