[SQOOP-3158] Columns added to Mysql after initial sqoop import, export back to table with same schema fails

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.6
• Fix Version/s: 1.4.7
• Labels: newbie
• Assignee: Eric Lin
• Reporter: viru reddy
• Created: 22/Mar/17 03:09
• Updated: 16/Jun/17 17:50
• Resolved: 11/Jun/17 04:37

Description

I have table in MySQL with 2 columns until yesterday. The columns are id and name.

1,Raj
2,Jack

I have imported this data into HDFS yesterday itself as a file. Today we added a new column to the table in MySQL called salary. The table looks like below.

1,Raj
2,Jack
3,Jill,2000
4,Nick,3000

Now I have done Incremental import on this table as a file.

Part-m-00000 file contains

1,Raj
2,Jack

Part-m-00001 file contains

3,Jill,2000
4,Nick,3000

Now I created a new table in MySQL with same schema as Original MySQL table with columns id name and salary.

When I do sqoop export only last 2 rows are getting inserted to the new table in MySQL and the sqoop export fails

How can I reflect all the rows to be inserted to the table.

Issue Links

• is cloned by: SQOOP-3198 Fix DirectMySQLExportTest and OracleExportTest