[HUDI-2319] Integrate hudi with dbt (data build tool)

• Type: New Feature
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: Usability
• Labels: integration pull-request-available
• Assignee: Vinoth Govindarajan
• Reporter: Vinoth Govindarajan
• Created: 19/Aug/21 00:25
• Updated: 12/Apr/22 22:51
• Resolved: 12/Apr/22 22:51

Description

dbt (data build tool) enables analytics engineers to transform data in their warehouses by simply writing select statements. dbt handles turning these select statements into tables and views.

dbt does the T in ELT (Extract, Load, Transform) processes – it doesn’t extract or load data, but it’s extremely good at transforming data that’s already loaded into your warehouse.

 

dbt currently supports only delta file format, there are few folks in the dbt community asking for hudi integration, moreover, adding dbt integration will make it easier to create derived datasets for any data engineer/analyst.

 

 

Issue Links

• links to: GitHub Pull Request #5220