[FLINK-13917] Add class for RegexTokenizerMapper.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Component/s: Library / Machine Learning
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Xu Yang
• Created: 30/Aug/19 10:13
• Updated: 16/Oct/22 08:27
• Resolved: 16/Oct/22 08:27

Description

RegexTokenizerMapper  is  a  transformer  to  extract  tokens  or  repeatedly  match  patterns.

• Add  RegexTokenizerMapper  for  the  operation  of  the  RegexTokenizerMapper.
• Add  RegexTokenizerMapperParams  for  the  params  of  RegexTokenizerMapper.
• Add  RegexTokenizerMapperTest  for  the  test  example.

Issue Links

• Dependent: FLINK-13513 Add the Mapper and related classes for later algorithm implementations.
• Dependent: FLINK-13577 Add an util class to build result row and generate result schema.
• Dependent: FLINK-13667 Add the utility class for the Table
• Dependent: FLINK-13668 Add abstract classes for three typical scenarios of (Flat)Mapper.
• Dependent: FLINK-13913 Add class for NLPConstant.
• links to: GitHub Pull Request #9573