Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1037

Cannot import mysql table with into Hadoop

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.4.3
    • Fix Version/s: no-release
    • Component/s: tools
    • Labels:
      None
    • Environment:

      Description

      Hi,

      I run Sqoop 1.4.3 on Apache Hadoop 1.0.4 and want to import table from mysql, but met below errors. I also searched jira site for this issue, but didn't find any useful info, please help to check. thanks!

      bl1253{wenzhiw}/local/wenzhiw/sqoop2/sqoop-1.4.3.bin__hadoop-0.23/bin>sqoop import --table IMSI --connect jdbc:mysql://135.252.158.250/hlr --username root -P
      Warning: /usr/lib/hbase does not exist! HBase imports will fail.
      Please set $HBASE_HOME to the root of your HBase installation.
      Warning: $HADOOP_HOME is deprecated.
      
      Enter password:
      13/05/08 10:20:53 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
      13/05/08 10:20:53 INFO tool.CodeGenTool: Beginning code generation
      13/05/08 10:20:54 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `IMSI` AS t LIMIT 1
      13/05/08 10:20:55 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `IMSI` AS t LIMIT 1
      13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
      13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
      13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
      13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
      13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
      13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
      ...
      

      Table definition:

      mysql> desc IMSI;
      +-------------------------------+-------------+------+-----+---------+-------+
      | Field                         | Type        | Null | Key | Default | Extra |
      +-------------------------------+-------------+------+-----+---------+-------+
      | mSubIdentificationNumberId    | binary(6)   | NO   | PRI | NULL    |       |
      | mobileNetworkCodeId           | binary(3)   | NO   | PRI | NULL    |       |
      | mobileCountryCodeId           | binary(3)   | NO   | PRI | NULL    |       |
      | mainMSISDN                    | binary(12)  | YES  |     | NULL    |       |
      | alertMSISDN                   | binary(12)  | YES  |     | NULL    |       |
      | associatedMSISDN              | binary(88)  | YES  |     | NULL    |       |
      | gprsNotReachableReason        | tinyint(4)  | YES  |     | NULL    |       |
      | sgsnLastGlobalUpdateTime      | int(11)     | YES  |     | NULL    |       |
      | vlrIsdn                       | binary(10)  | YES  |     | NULL    |       |
      | mscIsdn                       | binary(10)  | YES  |     | NULL    |       |
      | supOfLocRegCount              | tinyint(4)  | YES  |     | NULL    |       |
      | locRegSubsPeriod              | smallint(6) | YES  |     | NULL    |       |
      | inducedCbocBsg                | binary(7)   | YES  |     | NULL    |       |
      | inducedCboiBsg                | binary(7)   | YES  |     | NULL    |       |
      | inducedCboehBsg               | binary(7)   | YES  |     | NULL    |       |
      | vlrLastGlobalUpdateTime       | int(11)     | YES  |     | NULL    |       |
      | currentMapScreeningProfile    | int(11)     | YES  |     | NULL    |       |
      | smscIsdn                      | binary(70)  | YES  |     | NULL    |       |
      | gsmNotReachableReason         | tinyint(4)  | YES  |     | NULL    |       |
      | timeStampWaitingSms           | binary(28)  | YES  |     | NULL    |       |
      | checkSSindicator              | tinyint(4)  | YES  |     | NULL    |       |
      | supOfAutReqCount              | tinyint(4)  | YES  |     | NULL    |       |
      | autReqSubsPeriod              | smallint(6) | YES  |     | NULL    |       |
      | underTestImsi                 | bit(1)      | YES  |     | NULL    |       |
      | cardStatus                    | bit(1)      | YES  |     | NULL    |       |
      | 
      +-------------------------------+-------------+------+-----+---------+-------+
      

      Thanks,
      Wenzhi

        Attachments

        1. sqoop_import_error.log
          23 kB
          wenzhi wang

          Activity

            People

            • Assignee:
              jarcec Jarek Jarcec Cecho
              Reporter:
              wangwenzhi@sina.cn wenzhi wang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 504h
                504h
                Remaining:
                Remaining Estimate - 504h
                504h
                Logged:
                Time Spent - Not Specified
                Not Specified