[NIFI-3866] Create PartitionRecord processor to compliment UpdateRecord and RecordPath

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Extensions
• Assignee: Unassigned
• Reporter: Joe Witt
• Created: 11/May/17 14:43
• Updated: 17/Aug/17 14:53
• Resolved: 17/Aug/17 14:53

Description

In https://issues.apache.org/jira/browse/NIFI-3838 an UpdateRecord and RecordPath construct is introduced. We should also build a PartitionRecord processor which will allow format/schema aware partitioning of record streams along identified matching column values. The matching value should show up as a FlowFile attribute on a given bundle of records such that it can be used for merging and other cases later. That also highlights the value of a need for MergeRecord which is format/schema aware. We can do merge later on if appropriate. This should all work as well with a LookupRecord processor which can interact with a controller service to lookup a value found in a record using RecordPath and then then the value can be turned into a flowfile attribute, used for routing, or using RecordPath placed back into the record to replace an existing value or make a new one.

Issue Links

• duplicates: NIFI-3857 Create PartitionRecord processor
• relates to: NIFI-3838 Create UpdateRecord processor and provide a RecordPath DSL to specify fields