Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1400

Failed to import data using mysql-connector-java-5.1.17.jar

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.5
    • Fix Version/s: 1.4.6
    • Component/s: connectors/mysql
    • Labels:
      None
    • Environment:

      centos-6.4

      Description

      sqoop 1.4.5 + mysql-connector-java-5.1.31.jar, which is the latest version (works fine)
      sqoop 1.4.5 + mysql-connector-java-5.1.17.jar, which is the default version on centos 6.4 installed by rpm (fails with error message showed below)

      14/07/24 10:44:48 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `test1` AS t LIMIT 1
      14/07/24 10:44:48 ERROR manager.SqlManager: Error reading from database: java.sql.SQLException: Streaming result set com.mysql.jdbc.RowDataDynamic@1cfabc3a is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
      java.sql.SQLException: Streaming result set com.mysql.jdbc.RowDataDynamic@1cfabc3a is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
      	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:934)
      	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:931)
      	at com.mysql.jdbc.MysqlIO.checkForOutstandingStreamingData(MysqlIO.java:2735)
      	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1899)
      	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2151)
      	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2619)
      	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2569)
      	at com.mysql.jdbc.StatementImpl.executeQuery(StatementImpl.java:1521)
      	at com.mysql.jdbc.ConnectionImpl.getMaxBytesPerChar(ConnectionImpl.java:3003)
      	at com.mysql.jdbc.Field.getMaxBytesPerCharacter(Field.java:602)
      	at com.mysql.jdbc.ResultSetMetaData.getPrecision(ResultSetMetaData.java:445)
      	at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:285)
      	at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:240)
      	at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:226)
      	at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295)
      	at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1773)
      	at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1578)
      	at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96)
      	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
      	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
      	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
      	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
      	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
      	at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      14/07/24 10:44:48 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: No columns to generate for ClassWriter
      	at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1584)
      	at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96)
      	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
      	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
      	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
      	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
      	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
      	at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      

        Attachments

        1. patch.diff
          1 kB
          Richard

          Issue Links

            Activity

              People

              • Assignee:
                richard_zhou Richard
                Reporter:
                richard_zhou Richard
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: