[HUDI-1631] Sort data when creating a new version of file

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: writer-core
• Story Points: 3
• Epic Link: Improve data locality during ingestion
• Assignee: Ethan Guo
• Reporter: satish
• Created: 18/Feb/21 21:04
• Updated: 10/Mar/23 01:50

Description

Add option to sort data by specific file when creating new version of file. Anytime we open a file and write data (whehther to apply updates/add new records), we want to sort data in the file by specified column(s).