Sqoop
  1. Sqoop
  2. SQOOP-482

import tool for mysql direct mode reports wrong record number

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4.1-incubating
    • Fix Version/s: 1.4.2
    • Component/s: connectors/mysql
    • Labels:
      None
    • Environment:

      hadoop 1.0.0

      Description

      When run the sqoop import (via mysqldump) task :
      sqoop import --connect jdbc:mysql://[ip]:3306/mysqlslap --table t1 --username root -P --hive-import --hive-overwrite --hive-table tTable --verbose --direct -m 1
      The console shows this(part of the log):
      12/05/02 16:21:16 INFO mapred.JobClient: Map output records=6000594
      12/05/02 16:21:16 INFO mapreduce.ImportJobBase: Retrieved 6000594 records.
      However,the real record number in mysql is 1000099.And the number of records in hive is 1000099 ,too.
      So only the console log report the wrong number.

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Nemon Lou
            Reporter:
            Nemon Lou
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development