[SQOOP-1037] Cannot import mysql table with into Hadoop

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.4.3
• Fix Version/s: no-release
• Component/s: tools

Environment

bl1253

{wenzhiw}/home/wenzhiw>cat /etc/redhat-release
Scientific Linux SL release 5.3 (Boron)

bl1253{wenzhiw}

/home/wenzhiw>uname -a
Linux bl1253.cn.alcatel-lucent.com 2.6.18-128.7.1.el5PAE #1 SMP Mon Aug 24 08:41:30 EDT 2009 i686 athlon i386 GNU/Linux

• Assignee: Jarek Jarcec Cecho
• Reporter: wenzhi wang
• Created: 09/May/13 03:06
• Updated: 22/May/13 05:45
• Resolved: 22/May/13 05:45

Description

Hi,

I run Sqoop 1.4.3 on Apache Hadoop 1.0.4 and want to import table from mysql, but met below errors. I also searched jira site for this issue, but didn't find any useful info, please help to check. thanks!

bl1253{wenzhiw}/local/wenzhiw/sqoop2/sqoop-1.4.3.bin__hadoop-0.23/bin>sqoop import --table IMSI --connect jdbc:mysql://135.252.158.250/hlr --username root -P
Warning: /usr/lib/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: $HADOOP_HOME is deprecated.

Enter password:
13/05/08 10:20:53 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
13/05/08 10:20:53 INFO tool.CodeGenTool: Beginning code generation
13/05/08 10:20:54 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `IMSI` AS t LIMIT 1
13/05/08 10:20:55 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `IMSI` AS t LIMIT 1
13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
13/05/08 10:20:55 ERROR orm.ClassWriter: No parser available for Java type org.apache.hadoop.io.BytesWritable
...

Table definition:

mysql> desc IMSI;
+-------------------------------+-------------+------+-----+---------+-------+
| Field                         | Type        | Null | Key | Default | Extra |
+-------------------------------+-------------+------+-----+---------+-------+
| mSubIdentificationNumberId    | binary(6)   | NO   | PRI | NULL    |       |
| mobileNetworkCodeId           | binary(3)   | NO   | PRI | NULL    |       |
| mobileCountryCodeId           | binary(3)   | NO   | PRI | NULL    |       |
| mainMSISDN                    | binary(12)  | YES  |     | NULL    |       |
| alertMSISDN                   | binary(12)  | YES  |     | NULL    |       |
| associatedMSISDN              | binary(88)  | YES  |     | NULL    |       |
| gprsNotReachableReason        | tinyint(4)  | YES  |     | NULL    |       |
| sgsnLastGlobalUpdateTime      | int(11)     | YES  |     | NULL    |       |
| vlrIsdn                       | binary(10)  | YES  |     | NULL    |       |
| mscIsdn                       | binary(10)  | YES  |     | NULL    |       |
| supOfLocRegCount              | tinyint(4)  | YES  |     | NULL    |       |
| locRegSubsPeriod              | smallint(6) | YES  |     | NULL    |       |
| inducedCbocBsg                | binary(7)   | YES  |     | NULL    |       |
| inducedCboiBsg                | binary(7)   | YES  |     | NULL    |       |
| inducedCboehBsg               | binary(7)   | YES  |     | NULL    |       |
| vlrLastGlobalUpdateTime       | int(11)     | YES  |     | NULL    |       |
| currentMapScreeningProfile    | int(11)     | YES  |     | NULL    |       |
| smscIsdn                      | binary(70)  | YES  |     | NULL    |       |
| gsmNotReachableReason         | tinyint(4)  | YES  |     | NULL    |       |
| timeStampWaitingSms           | binary(28)  | YES  |     | NULL    |       |
| checkSSindicator              | tinyint(4)  | YES  |     | NULL    |       |
| supOfAutReqCount              | tinyint(4)  | YES  |     | NULL    |       |
| autReqSubsPeriod              | smallint(6) | YES  |     | NULL    |       |
| underTestImsi                 | bit(1)      | YES  |     | NULL    |       |
| cardStatus                    | bit(1)      | YES  |     | NULL    |       |
| 
+-------------------------------+-------------+------+-----+---------+-------+

Thanks,
Wenzhi