Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-482

import tool for mysql direct mode reports wrong record number

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4.1-incubating
    • Fix Version/s: 1.4.2
    • Component/s: connectors/mysql
    • Labels:
      None
    • Environment:

      hadoop 1.0.0

      Description

      When run the sqoop import (via mysqldump) task :
      sqoop import --connect jdbc:mysql://[ip]:3306/mysqlslap --table t1 --username root -P --hive-import --hive-overwrite --hive-table tTable --verbose --direct -m 1
      The console shows this(part of the log):
      12/05/02 16:21:16 INFO mapred.JobClient: Map output records=6000594
      12/05/02 16:21:16 INFO mapreduce.ImportJobBase: Retrieved 6000594 records.
      However,the real record number in mysql is 1000099.And the number of records in hive is 1000099 ,too.
      So only the console log report the wrong number.

        Attachments

          Activity

            People

            • Assignee:
              nemon Nemon Lou
              Reporter:
              nemon Nemon Lou
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: