[SQOOP-1168] Sqoop2: Delta Fetch/ Merge ( formerly called Incremental Import )

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Assignee: Veena Basavaraj
• Reporter: Hari Shreedharan
• Created: 09/Aug/13 18:32
• Updated: 30/Apr/15 19:31
• Resolved: 30/Apr/15 19:31

Description

The formal design wiki is here
https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+and+Merge+Design

Issue Links

• depends upon: SQOOP-1516 Sqoop2: Config Input as a Top Level Entity - RepositoryAPI changes
• is depended upon by: SQOOP-1949 Sqoop2: HDFS append only support
• is related to: SQOOP-1808 Add Integration tests to for Incremental read / write between JDBC and HDFS
• is related to: SQOOP-1805 Sqoop2: GenericJdbcConnector: Delta read support

Sub-Tasks

• Support Incremental Semantics in command line tool for Job: Resolved
• Support Incremental semantics in the REST apis: Resolved
• Support a API/ command line utility to retrieve the last value or any JOB_OUTPUT: Resolved
• Connector API : Ability for connector to indicate if its FROM and TO support incremental reading/ writing: Resolved
• Delta Fetch Merge Config API : Validations for the Delta Fetch/Merge Configs: Resolved
• Sqoop2: Update and save configuration upon job success: Resolved
• Repository changes: Add editable and override attribute to inputs: Resolved
• Sqoop2: Add input attributes documentation: Resolved
• Sqoop2: Add editable and override attributes for postgres: Resolved
• Sqoop2: Fix Indentation in input attributes documentation: Resolved
• Support for LONG in MInputType: Resolved