Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2994

Incremental lastmodified lower bound value not getting updated

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      I am using incremental lastmodified import and when I am running the job after the first run the lower bound is not getting updated.

      Suppose I am running the sqoop import job on 3/08/2016, all the data from the oracle table is imported properly. The incremental last value is changed to the current TS. Now if I run the on 4/08/2016, the incremental last value is not updated to current TS. This is going to affect the run for 5/08/2016.

      My sqoop command:
      sqoop job --create jobname – import --connect connectionstring --username username --password-file password_file --table tablename --columns "col1,col2,col3" --target-dir target_dir --incremental lastmodified --check-column UPDATED_TS --last-value '2016-07-11 00:00:00.0'

      I was getting some file already exist error for the target dir, so I am recreating the target dir for each load.

      Sqoop version: Sqoop 1.4.5.2.2.0.0-2041

      Attachments

        Activity

          People

            Unassigned Unassigned
            ektadhusia Ekta Dhusia
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: