[NIFI-6976] Native integrations of Apache Nifi with Delta Lake

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Extensions
• Labels: ACID delta integration spark storage-layer
• Assignee: Unassigned
• Reporter: Martin
• Created: 02/Jan/20 10:33
• Updated: 29/Jul/20 21:38
• Resolved: 01/Feb/20 21:02

Description

"Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spar and big data workloads" (https://delta.io/)

 

NiFi already offers many features that make it unique. A Delta integration would complement this scope in a sensible way.

 

Source: https://github.com/delta-io/delta

 ## Update ##

Here is a demo how this looks at Streamsets. Having the same feature set on Nifi would we awesome.

Video: https://youtu.be/VLd_qOrKrTI

 

Here you can find all available integrations right now.
https://docs.delta.io/0.5.0/integrations.html

 

 

Issue Links

• is superceded by: NIFI-7090 Create Processors for Transactional Hadoop Table Formats