Details
-
Wish
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
From what I understand, for the lastmodified update method, Sqoop selects records where timestamp_column >= last modified timestamp and timestamp column < current_time. Is there a way to customize that current_time upper bound? I'd like to do something like current_time - 1 hour.
We have transactions being created on one server, then replicated to another server, then Sqooped from there. I noticed some missing data in our cluster and I believe replication delay is the cause. This new feature would be a great way to work around the replication delay.