Sqoop
  1. Sqoop
  2. SQOOP-327

Mixed update/insert export support for OracleManager

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0-incubating
    • Component/s: None
    • Labels:
      None

      Description

      Currently Sqoop export job runs in insert mode (default) or update mode (with --update-key option). When in insert mode, all data are inserted and when in update mode, all data are updated in existing table. This leaves out the use case where some data may need to be updated while the rest needs to be inserted.

      It also causes problems

      • When in insert mode, new data may cause constraint violations if they exist already.
      • When in update mode, it could result in silent dropping of records that do not match the update key.

      The idea is to introduce a new "upsert" mode to update records if they exist in table already or to insert records if they do not exist yet.

      1. SQOOP-327.diff
        23 kB
        Bilung Lee

        Activity

        Bilung Lee created issue -
        Bilung Lee made changes -
        Field Original Value New Value
        Attachment SQOOP-327.diff [ 12493678 ]
        Bilung Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Bilung Lee made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Arvind Prabhakar made changes -
        Fix Version/s 1.4.0-incubating [ 12317345 ]

          People

          • Assignee:
            Bilung Lee
            Reporter:
            Bilung Lee
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development