Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2915

Catalog leaks HiveMetaStoreClient connections

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      The catalog is leaking connections to the Hive Metastore. For example, see the reloadTable() function in CatalogServiceCatalog:

         catalogLock_.writeLock().lock();
          synchronized(tbl) {
            long newCatalogVersion = incrementAndGetCatalogVersion();
            catalogLock_.writeLock().unlock();
            MetaStoreClient msClient = getMetaStoreClient();
            org.apache.hadoop.hive.metastore.api.Table msTbl = null;
            try {
              msTbl = msClient.getHiveClient().getTable(db.getName(), tblName.getTable_name());
            } catch (Exception e) {
              throw new TableLoadingException("Error loading metadata for table: " +
                  db.getName() + "." + tblName.getTable_name(), e);
            }
            tbl.load(true, msClient.getHiveClient(), msTbl);
            tbl.setCatalogVersion(newCatalogVersion);
            return tbl;
          }
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            dtsirogiannis Dimitris Tsirogiannis
            dtsirogiannis Dimitris Tsirogiannis
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment