[SOLR-2980] DataImportHandler becomes unresponsive with Microsoft JDBC driver

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.4, 3.5
• Component/s: contrib - DataImportHandler
• Labels: dataimport jdbc solr sql sqlserver

Environment

Java JRE 1.6.0_20, JRE 1.6.0_29, CentOS (kernel 2.6.18-274.3.1.e15), Microsoft SQL Server JDBC Driver 3.0

• Assignee: Unassigned
• Reporter: Steve Wolfe
• Created: 19/Dec/11 23:03
• Updated: 21/Dec/11 12:36
• Resolved: 21/Dec/11 12:29

Description

A solr core has been configured to use the DataImportHandler to read a set of documents from a Microsoft SQL Server database, via the Microsoft JDBC driver. A known-good configuration for the data import handler is used, and a "reload-config" followed by "full-import" command are issued to the DataImportHandler.

The handler switches to a status of "A command is still running...", and shows 1 request has been made to the data source. Subsequent status calls show the Time Elapsed growing, but the handler fails to perform any action--SQL Server confirms that a login event occurs, but no queries are issued. Solr does not throw any exceptions, even after a very long duration. The last message in Solr's output is "INFO: Creating a connection for entity

{entity name}

with URL:

{entity datasource url}

"

Attempts to issue an Abort command to the DataImportHandler appear successful, but do no stop the operation.

Running the solr instance with the "java -verbose" flag shows the following:

IMMEDIATELY UPON EXECUTING "FULL-IMPORT" COMMAND
[Loaded com.microsoft.sqlserver.jdbc.StreamPacket from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
[Loaded com.microsoft.sqlserver.jdbc.StreamLoginAck from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]
[Loaded com.microsoft.sqlserver.jdbc.StreamDone from file:/home/MYWEBGROCER/swolfe/downloads/apache-solr-3.5.0/example/lib/sqljdbc4.jar]

APPROXIMATELY 40 SECONDS LATER
[Loaded java.io.InterruptedIOException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
[Loaded java.net.SocketTimeoutException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]
[Loaded sun.net.ConnectionResetException from /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86_64/jre/lib/rt.jar]

An issue with identical symptoms has been reported on StackOverflow (the OP found that using a 3rd party JDBC driver appeared successful): http://stackoverflow.com/questions/8269038/solr-dataimporthandler-logs-into-sql-but-never-fetches-any-data