Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25483

TxnHandler::acquireLock should close the DB conn to avoid connection leaks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      TxnHandler::acquireLock should close DB connection on exiting the function.

      https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L5688

      https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L5726

      https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java#L5737-L5740

       If there are any exceptions downstream, this connection isn't closed cleanly. In a corner case, hikari connection leak detector reported the following

      2021-08-26 09:19:18,102 WARN  com.zaxxer.hikari.pool.ProxyLeakTask: [HikariPool-4 housekeeper]: Connection leak detection triggered for org.postgresql.jdbc.PgConnection@77f76747, stack trace follows
      java.lang.Exception: Apparent connection leak detected
              at org.apache.hadoop.hive.metastore.txn.TxnHandler.getDbConn(TxnHandler.java:3843)
              at org.apache.hadoop.hive.metastore.txn.TxnHandler.acquireLock(TxnHandler.java:5135) 
              at org.apache.hadoop.hive.ql.txn.compactor.Initiator.run(Initiator.java:107) 

      Attachments

        Issue Links

          Activity

            People

              rkirtir KIRTI RUGE
              rajesh.balamohan Rajesh Balamohan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: