[DRILL-6720] Unable to read more than 1000 records from DB2 table

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.9.0
• Component/s: Client - JDBC, Storage - JDBC
• Assignee: Unassigned
• Reporter: kshitij
• Created: 29/Aug/18 06:26
• Updated: 16/Apr/19 07:27
• Resolved: 16/Apr/19 07:27

Description

We have created a storage plugin in drill for DB2 database, PFB the details:

{ "type": "jdbc", "driver": "com.ibm.db2.jcc.DB2Driver", "url": "jdbc:db2://server:port/databasename", "username": "user", "password": "password", "enabled": true }

Version of DB2 is 10.1. We are using a type 4 JDBC driver (db2jcc4.jar).
When we try to read the data in any of the tables, the query fails with following error from drill:

org.apache.drill.common.exceptions.UserRemoteException: DATA_READ ERROR: Failure while attempting to read from database. sql SELECT * FROM schema.table plugin DB2_PLUGIN Fragment 0:0 [Error Id: 1404544f-bb5e-439b-b1a8-679388bb344d on server:port]
The error logs from drill have been attached.

One interesting observation - when we put a LIMIT clause of <=1000 to the query, the query works and returns the data. Anything more than 1000 in LIMIT clause throws back the same error as above.