Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13729

FileSystem$Cache leaks in FileUtils.checkFileAccessWithImpersonation

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.3.0, 2.1.0
    • HiveServer2
    • None
    • Reviewed

    Description

      Didn't invoke FileSystem.closeAllForUGI after checkFileAccess. This results leak in FileSystem$Cache and eventually OOM for HS2.

      Workaround without fix -
      fs.hdfs.impl.disable.cache=true
      fs.file.impl.disable.cache=true

      Attachments

        1. HIVE-13729.1.patch
          0.4 kB
          Daniel Dai
        2. HIVE-13729.2.patch
          1 kB
          Daniel Dai

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            daijy Daniel Dai Assign to me
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment