[HAWQ-1621] Call FileSystem.closeAllForUGI at the end of request when PXF impersonation is on

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.4.0.0
• Component/s: PXF
• Assignee: Alexander Denissov
• Reporter: Divya Bhargov
• Created: 31/May/18 18:05
• Updated: 31/May/18 23:58
• Resolved: 31/May/18 23:58

Description

Due to open Hadoop JIRA: https://issues.apache.org/jira/browse/HDFS-3545 , when PXF impersonation is on, proxy UGIs created for each request produce FileSystem cache entries that are not removed when the request is over. This causes OutOfMemory errors since the entries are never removed. To remove the entries and clean the cache, we should call FileSystem.closeAllForUGI at the end of request when PXF impersonation is on.

Issue Links

• links to: GitHub Pull Request #1374