Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-482

import tool for mysql direct mode reports wrong record number

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.4.1-incubating
    • 1.4.2
    • connectors/mysql
    • None
    • hadoop 1.0.0

    Description

      When run the sqoop import (via mysqldump) task :
      sqoop import --connect jdbc:mysql://[ip]:3306/mysqlslap --table t1 --username root -P --hive-import --hive-overwrite --hive-table tTable --verbose --direct -m 1
      The console shows this(part of the log):
      12/05/02 16:21:16 INFO mapred.JobClient: Map output records=6000594
      12/05/02 16:21:16 INFO mapreduce.ImportJobBase: Retrieved 6000594 records.
      However,the real record number in mysql is 1000099.And the number of records in hive is 1000099 ,too.
      So only the console log report the wrong number.

      Attachments

        1. SQOOP-482-1.patch
          2 kB
          Nemon Lou

        Activity

          People

            nemon Nemon Lou
            nemon Nemon Lou
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: