Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1658 [UMBRELLA] Spark Sql Support For Hudi
  3. HUDI-2470

use commit_time in the WHERE STATEMENT to optimize the incremental query

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      In the module of DeltaStreamer,  Option of  QUERY_TYPE_OPT_KEY and BEGIN_INSTANTTIME_OPT_KEY is used to tell the DeltaStreamer to query data after the specific time.  

      Such as method is not very convenient for user.  So if we can implement the function that User can set BEGIN_INSTANTTIME_OPT_KEY  and BEGIN_INSTANTTIME_OPT_KEY  at the sql, which is not only  very convinient for user, also very a  elegant implementation.

      Attachments

        Activity

          People

            David_Liang David_Liang
            David_Liang David_Liang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: