[NIFI-5989] Improve PutKudu BatchSize handling - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.9.0
Component/s: Extensions
Labels:
- kudu
- nifi

Flags:

Patch

Description

Current "Batch size" property of PutKudu affects both: the number of Flowfiles pulled per OnTrigger and the size of the Kudu client modification buffer.

If the Flowfiles contain a considerable amount of records, then a disproportionate amount of data is pulled in and deserialized into memory, when in AUTO_FLUSH_BACKGROUND mode.

We propose introducing a separate setting for the batch size of FlowFiles.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

0001-NIFI-5989-PutKudu-Additional-FF-Queue-length-setting.patch
31/Jan/19 09:49
5 kB
Alex Goos

Activity

People

Assignee:: Unassigned

Reporter:: Alex Goos

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 31/Jan/19 08:41

Updated:: 08/Feb/19 21:09

Resolved:: 08/Feb/19 21:09