[TEZ-3566] OOM because of too many DFSClient instances in TokenCache.obtainTokensForFileSystems - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.9.0, 0.8.5
Component/s: None
Labels:
None

Description

When FileSystem cache is disabled, invoking TokenCache.obtainTokensForFileSystems creates lot of FileSystem objects which are unique and stored in a hash set. This takes up lot of memory and causes OOM.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

TEZ-3566.01.patch
20/Dec/16 09:48
4 kB
Harish JP
TEZ-3566.02.patch
05/Jan/17 10:43
5 kB
Harish JP
TEZ-3566.03.patch
09/Jan/17 08:08
5 kB
Harish JP

Activity

People

Assignee:: Harish JP

Reporter:: Harish JP

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 20/Dec/16 09:45

Updated:: 14/Mar/17 03:49

Resolved:: 10/Jan/17 03:04