[NIFI-11608] PutBigQuery: Missing Flowfile Attribute Evaluation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.21.0
• Fix Version/s: 2.0.0-M1, 1.22.0
• Component/s: Core Framework
• Assignee: Steven Matison
• Reporter: Juan Ignacio Saitua
• Created: 26/May/23 22:07
• Updated: 31/May/23 19:34
• Resolved: 31/May/23 19:34

Description

While the documentation states that PutBigQuery should support expression language for DATASET, TABLE_NAME, and SKIP_INVALID_ROWS, that's not really happening. An examination of the code reveals that these expressions are not evaluated in the current implementation ([see code here](https://github.com/apache/nifi/blob/cfd62c9511e43d5010fbfbb12b98b40bdfdb3fc2/nifi-nar-bundles/nifi-gcp-bundle/nifi-gcp-processors/src/main/java/org/apache/nifi/processors/gcp/bigquery/PutBigQuery.java#L193)). Notably, the issue does not exist in the PutBigQueryBatch processor. While both processors extends the AbstractBigQueryProcessor class, only PutBigQueryBatch utilizes the AbstractBigQueryProcessor.getTableId() method, which correctly evaluates and retrieves the tableId.

Issue Links

• links to: GitHub Pull Request #7316