Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-498 End to end to check HiveIncrementalPuller
  3. HUDI-496

Fix wrong check logic in HoodieIncrementalPull

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • incremental-query
    • None

    Description

       Wrong check logic, right statement can not go throungh.

      select `_hoodie_commit_time`, symbol, ts from default.stock_ticks_cow where  symbol = 'GOOG' and `_hoodie_commit_time` > '20180924064621'
      

       

      Exception Stackstrace

      Exception in thread "main" org.apache.hudi.utilities.exception.HoodieIncrementalPullSQLException: Incremental SQL does not have clause `_hoodie_commit_time` > '%targetBasePath', which means its not pulling incrementally
          at org.apache.hudi.utilities.HiveIncrementalPuller.executeIncrementalSQL(HiveIncrementalPuller.java:192)
          at org.apache.hudi.utilities.HiveIncrementalPuller.saveDelta(HiveIncrementalPuller.java:157)
          at org.apache.hudi.utilities.HiveIncrementalPuller.main(HiveIncrementalPuller.java:345)
      
      

       

       

      Attachments

        Activity

          People

            lamber-ken lamber-ken
            lamber-ken lamber-ken
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: