Uploaded image for project: 'Apache HAWQ'
  1. Apache HAWQ
  2. HAWQ-1621

Call FileSystem.closeAllForUGI at the end of request when PXF impersonation is on

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.4.0.0
    • PXF
    • None

    Description

      Due to open Hadoop JIRA: https://issues.apache.org/jira/browse/HDFS-3545 , when PXF impersonation is on, proxy UGIs created for each request produce FileSystem cache entries that are not removed when the request is over. This causes OutOfMemory errors since the entries are never removed. To remove the entries and clean the cache, we should call FileSystem.closeAllForUGI at the end of request when PXF impersonation is on.

      Attachments

        Issue Links

          Activity

            People

              adenissov Alexander Denissov
              dbhargov Divya Bhargov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: