[HUDI-507] Support \ t split hdfs source

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Duplicate
• Fix Version/s: 0.6.0
• Component/s: Utilities
• Assignee: liujinhui
• Reporter: liujinhui
• Created: 07/Jan/20 13:15
• Updated: 09/May/20 06:59
• Resolved: 09/May/20 06:59

Description

hi,hudi

 

Current Hudi data source does not support HDFS file data splitting with \ t separator
I want to complete it and contribute to the community.
The main change is the addition of the TextDFSSource class to provide support.
The specific new logic is: split the hdfs data according to the delimiter, and then map it to the source.avsc pattern

 

Or do some other symbol format as an extension

thanks,

liujh

 

vinoth   Please help with suggestions