[HIVE-4166] closeAllForUGI causes failure in hiveserver2 when fetching large amount of data

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.0, 0.11.0
• Component/s: HiveServer2, Security, Shims
• Tags: HiveServer2 doAs Shims
• Assignee: Chris Drome
• Reporter: Chris Drome
• Created: 14/Mar/13 00:04
• Updated: 02/Dec/16 19:25

Description

HiveServer2 configured to use Kerberos authentication with doAs enabled throws an exception when fetching a large amount of data from a query.

The exception is caused because FileSystem.closeAllForUGI is always called at the end of TUGIAssumingProcessor.process. This affects requests on the ResultSet for data from a SELECT query when the amount of data exceeds a certain size. At that point any subsequent calls to fetch more data throw an exception because the underlying DFSClient has been closed.