Uploaded image for project: 'Apache HAWQ'
  1. Apache HAWQ
  2. HAWQ-1621

Call FileSystem.closeAllForUGI at the end of request when PXF impersonation is on

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.4.0.0
    • Component/s: PXF
    • Labels:
      None

      Description

      Due to open Hadoop JIRA: https://issues.apache.org/jira/browse/HDFS-3545 , when PXF impersonation is on, proxy UGIs created for each request produce FileSystem cache entries that are not removed when the request is over. This causes OutOfMemory errors since the entries are never removed. To remove the entries and clean the cache, we should call FileSystem.closeAllForUGI at the end of request when PXF impersonation is on.

        Attachments

          Issue Links

          links to

          Web Link GitHub Pull Request #1374

            Activity

              People

              • Assignee:
                adenissov Alexander Denissov
                Reporter:
                dbhargov Divya Bhargov
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: