Sqoop
  1. Sqoop
  2. SQOOP-482

import tool for mysql direct mode reports wrong record number

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4.1-incubating
    • Fix Version/s: 1.4.2
    • Component/s: connectors/mysql
    • Labels:
      None
    • Environment:

      hadoop 1.0.0

      Description

      When run the sqoop import (via mysqldump) task :
      sqoop import --connect jdbc:mysql://[ip]:3306/mysqlslap --table t1 --username root -P --hive-import --hive-overwrite --hive-table tTable --verbose --direct -m 1
      The console shows this(part of the log):
      12/05/02 16:21:16 INFO mapred.JobClient: Map output records=6000594
      12/05/02 16:21:16 INFO mapreduce.ImportJobBase: Retrieved 6000594 records.
      However,the real record number in mysql is 1000099.And the number of records in hive is 1000099 ,too.
      So only the console log report the wrong number.

        Activity

        Kathleen Ting made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Arvind Prabhakar made changes -
        Assignee nemon lou [ nemon ]
        Nemon Lou made changes -
        Attachment directmodewrongnumber.patch [ 12525417 ]
        Nemon Lou made changes -
        Attachment SQOOP-482-1.patch [ 12525728 ]
        Nemon Lou made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Nemon Lou made changes -
        Comment [ I have upload it here https://reviews.apache.org/r/4988/diff/#index_header ]
        Nemon Lou made changes -
        Attachment directmodewrongnumber.patch [ 12525417 ]
        Nemon Lou made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Nemon Lou made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Nemon Lou created issue -

          People

          • Assignee:
            Nemon Lou
            Reporter:
            Nemon Lou
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development