Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2421

Sqoop incremental load using "lastmodified" fails when going against MSSQL

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Team,

      Not sure if I missed anything here, please feel free to correct me.

      I'm on Sqoop version: 1.4.5-cdh5.4.2.
      Trying to execute the following Sqoop Job:

      sqoop job --create test – import --check-column UpdatedDT --incremental lastmodified --last-value 1900-01-01 --connect 'jdbc:sqlserver://x.x.x.x:1433;databaseName=test' --username user --password password --table "Application.Test" --driver=com.microsoft.sqlserver.jdbc.SQLServerDriver -m 1 --hive-import --hive-table hivedb.Test

      Also, I have the sqljdbc4.jar in /usr/lib/sqoop/lib/

      And I'm hitting this error.
      15/07/22 04:27:00 ERROR manager.SqlManager: SQL exception accessing current timestamp: com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ')'.
      com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ')'.
      at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.doExecuteStatement(SQLServerStatement.java:792)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement$StmtExecCmd.doExecute(SQLServerStatement.java:689)
      at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696)
      at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155)
      at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeQuery(SQLServerStatement.java:616)
      at org.apache.sqoop.manager.SqlManager.getCurrentDbTimestamp(SqlManager.java:963)
      at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:328)
      at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:488)
      at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
      at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:228)
      at org.apache.sqoop.tool.JobTool.run(JobTool.java:283)
      at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
      at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      15/07/22 04:27:00 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Could not get current time from database
      at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:330)
      at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:488)
      at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
      at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:228)
      at org.apache.sqoop.tool.JobTool.run(JobTool.java:283)
      at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
      at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

      Please advice.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ananth.n.pal Ananth Pal
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: