[TEZ-1585] Memory leak in tez session mode - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.5.1
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

DAGAppMaster's memory gradually keeps increasing when running simple tez apps repeatedly in session mode. Taking memory snapshots revealed that FileSystem.CACHE is getting populated with some keys which are not being released.

Around 200KB of data is leaked for every job invocation in the session mode. I will attach the profiler snapshots soon. Haven't figured out yet on who makes the call to FileSystem.get() and not calling close().

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

TEZ-1585.1.patch
15/Sep/14 22:37
0.8 kB
Rajesh Balamohan
app_master.tar.gz
15/Sep/14 08:23
616 kB
Rajesh Balamohan

Activity

People

Assignee:: Rajesh Balamohan

Reporter:: Rajesh Balamohan

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 15/Sep/14 08:21

Updated:: 02/Oct/14 21:41

Resolved:: 16/Sep/14 06:46