[HUDI-2470] use commit_time in the WHERE STATEMENT to optimize the incremental query

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: incremental-query, performance
• Assignee: David_Liang
• Reporter: David_Liang

Reviewers

Forward Xu, Shiyan Xu

• Created: 21/Sep/21 12:21
• Updated: 23/Feb/22 07:03

Description

In the module of DeltaStreamer,  Option of  QUERY_TYPE_OPT_KEY and BEGIN_INSTANTTIME_OPT_KEY is used to tell the DeltaStreamer to query data after the specific time.  

Such as method is not very convenient for user.  So if we can implement the function that User can set BEGIN_INSTANTTIME_OPT_KEY  and BEGIN_INSTANTTIME_OPT_KEY  at the sql, which is not only  very convinient for user, also very a  elegant implementation.