[LENS-1456] Deadlock in jdbcdriver

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: driver-jdbc
• Assignee: Rajat Khandelwal
• Reporter: Amareshwari Sriramadasu
• Created: 24/Jul/17 05:29
• Updated: 06/Feb/18 05:53
• Resolved: 11/Aug/17 10:23

Description

Here are the details :

Found one Java-level deadlock:
=============================
"lens-driver-jdbc-795":
  waiting to lock monitor 0x00007f98200140a8 (object 0x0000000319a3dc88, a org.apache.lens.server.api.query.QueryContext),
  which is held by "query-cancellation-pool-Thread-3"
"query-cancellation-pool-Thread-3":
  waiting to lock monitor 0x00007f97ec002d08 (object 0x0000000319a8c6e0, a java.util.ArrayList),
  which is held by "lens-driver-jdbc-795"

Java stack information for the threads listed above:
===================================================
"lens-driver-jdbc-795":
        at org.apache.lens.server.query.QueryExecutionServiceImpl.updateStatus(QueryExecutionServiceImpl.java:1049)
        - waiting to lock <0x0000000319a3dc88> (a org.apache.lens.server.api.query.QueryContext)
        at org.apache.lens.server.query.QueryExecutionServiceImpl.access$1900(QueryExecutionServiceImpl.java:110)
        at org.apache.lens.server.query.QueryExecutionServiceImpl$AsyncStatusUpdater.onDriverStatusUpdated(QueryExecutionServiceImpl.java:853)
        at org.apache.lens.server.api.query.QueryContext.setDriverStatus(QueryContext.java:577)
        - locked <0x0000000319a8c6e0> (a java.util.ArrayList)
        at org.apache.lens.driver.jdbc.JDBCDriver$QueryCallable.call(JDBCDriver.java:299)
        at org.apache.lens.driver.jdbc.JDBCDriver$QueryCallable.call(JDBCDriver.java:237)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
"query-cancellation-pool-Thread-3":
        at org.apache.lens.server.api.query.QueryContext.setDriverStatus(QueryContext.java:575)
        - waiting to lock <0x0000000319a8c6e0> (a java.util.ArrayList)
        at org.apache.lens.server.api.query.QueryContext.setDriverStatus(QueryContext.java:587)
        at org.apache.lens.driver.jdbc.JDBCDriver.cancelQuery(JDBCDriver.java:962)
        at org.apache.lens.server.query.QueryExecutionServiceImpl.cancelQuery(QueryExecutionServiceImpl.java:2720)
        - locked <0x0000000319a3dc88> (a org.apache.lens.server.api.query.QueryContext)
        at org.apache.lens.server.query.QueryExecutionServiceImpl.access$3500(QueryExecutionServiceImpl.java:110)
        at org.apache.lens.server.query.QueryExecutionServiceImpl$CancelQueryTask.run(QueryExecutionServiceImpl.java:1667)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)

Found 1 deadlock.

Issue Links

• breaks: LENS-1464 One or two queued queries failing with ConcurrentModificationException on restart