[NIFI-4395] GenerateTableFetch can't fetch column type by state after instance reboot - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.6.0
Component/s: None
Labels:
None

Description

The problem can easily be reproduce.
Once GenerateTableFetch store state and encounter NiFi instance reboot.
(Dynamic naming table by expression language)
The exception will occur.

The error in source code is list below.

```
if (type == null)

{ // This shouldn't happen as we are populating columnTypeMap when the processor is scheduled or when the first maximum is observed throw new IllegalArgumentException("No column type found for: " + colName); }

```

When this situation happened. The FlowFile will also be grab and can't release or observed.
Processor can't grab existing column type from columnTypeMap through instance reboot.
Hence will inevidible get this exception, rollback FlowFile and never success.

QueryDatabaseTable processor will not encounter this exception due to it setup(context) every time,
While GenerateTableFetch will not pass the condition and thus try to fetch column type from 0 length columnTypeMap.

—
if (!isDynamicTableName && !isDynamicMaxValues)

{ super.setup(context); }

—

I can take the issue if it is recognize as bug.