Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-3158

Columns added to Mysql after initial sqoop import, export back to table with same schema fails

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.6
    • Fix Version/s: 1.4.7
    • Component/s: None
    • Labels:

      Description

      I have table in MySQL with 2 columns until yesterday. The columns are id and name.

      1,Raj
      2,Jack

      I have imported this data into HDFS yesterday itself as a file. Today we added a new column to the table in MySQL called salary. The table looks like below.

      1,Raj
      2,Jack
      3,Jill,2000
      4,Nick,3000

      Now I have done Incremental import on this table as a file.

      Part-m-00000 file contains

      1,Raj
      2,Jack

      Part-m-00001 file contains

      3,Jill,2000
      4,Nick,3000

      Now I created a new table in MySQL with same schema as Original MySQL table with columns id name and salary.

      When I do sqoop export only last 2 rows are getting inserted to the new table in MySQL and the sqoop export fails

      How can I reflect all the rows to be inserted to the table.

        Attachments

        1. SQOOP-3158.patch
          0.9 kB
          Eric Lin
        2. SQOOP-3158.2.patch
          2 kB
          Eric Lin
        3. SQOOP-3158.3.patch
          5 kB
          Eric Lin
        4. SQOOP-3158.4.patch
          10 kB
          Eric Lin

          Issue Links

            Activity

              People

              • Assignee:
                ericlin Eric Lin
                Reporter:
                viru2006 viru reddy
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: