Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3158

Columns added to Mysql after initial sqoop import, export back to table with same schema fails

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.6
    • 1.4.7
    • None

    Description

      I have table in MySQL with 2 columns until yesterday. The columns are id and name.

      1,Raj
      2,Jack

      I have imported this data into HDFS yesterday itself as a file. Today we added a new column to the table in MySQL called salary. The table looks like below.

      1,Raj
      2,Jack
      3,Jill,2000
      4,Nick,3000

      Now I have done Incremental import on this table as a file.

      Part-m-00000 file contains

      1,Raj
      2,Jack

      Part-m-00001 file contains

      3,Jill,2000
      4,Nick,3000

      Now I created a new table in MySQL with same schema as Original MySQL table with columns id name and salary.

      When I do sqoop export only last 2 rows are getting inserted to the new table in MySQL and the sqoop export fails

      How can I reflect all the rows to be inserted to the table.

      Attachments

        1. SQOOP-3158.patch
          0.9 kB
          Eric Lin
        2. SQOOP-3158.4.patch
          10 kB
          Eric Lin
        3. SQOOP-3158.3.patch
          5 kB
          Eric Lin
        4. SQOOP-3158.2.patch
          2 kB
          Eric Lin

        Issue Links

          Activity

            People

              ericlin Eric Lin
              viru2006 viru reddy
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: