[NIFI-3404] Add lookup processor for enrichments/joins to reference data

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: Joey Frazee
• Reporter: Joey Frazee
• Created: 26/Jan/17 15:04
• Updated: 25/May/17 23:15
• Resolved: 25/May/17 16:12

Description

NiFi doesn't currently have an easy, concise way of doing enrichment, joining against reference data sets or performing attribute lookups against external data sources.

Since enrichments and joins are basic streaming use cases, and since attributes and EL are often used to parameterize processor properties, there is a need for an easy way to do enrichments, joins and lookups without having to write code or create a lengthy data flow.

There's been some discussion of this on the mailing list [1] and I've started work on a LookupAttribute [2] processor that delegates the work to controller services.

1. https://lists.apache.org/thread.html/74321ff0e9e0b7339e43ad53b36119315dc5094991605edfb12b34d0@%3Cdev.nifi.apache.org%3E
2. https://github.com/jfrazee/nifi-lookup-service

Issue Links

• is related to: NIFI-3863 Create a LookupRecord Processor
• links to: GitHub Pull Request #1830
• links to: GitHub Pull Request #1856