[TEZ-776] Reduce AM mem usage caused by storing TezEvents - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.7.0
Component/s: None
Labels:
None

Target Version/s:

0.7.0
Hadoop Flags:

Reviewed

Description

This is open ended at the moment.
A fair chunk of the AM heap is taken up by TezEvents (specifically DataMovementEvents - 64 bytes per event).
Depending on the connection pattern - this puts limits on the number of tasks that can be processed.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

TEZ-776.15.patch
07/May/15 21:34
148 kB
Bikas Saha
TEZ-776.14.patch
06/May/15 22:15
148 kB
Bikas Saha
TEZ-776.13.patch
05/May/15 18:34
147 kB
Bikas Saha
TEZ-776.12.patch
05/May/15 03:19
147 kB
Bikas Saha
TEZ-776.11.patch
04/May/15 22:14
146 kB
Bikas Saha
TEZ-776.10.patch
01/May/15 21:03
133 kB
Bikas Saha
TEZ-776.9.patch
01/May/15 18:38
133 kB
Bikas Saha
TEZ-776.8.patch
01/May/15 17:04
129 kB
Bikas Saha
TEZ-776.7.patch
30/Apr/15 02:25
128 kB
Bikas Saha
TEZ-776.6.B.patch
28/Apr/15 23:44
123 kB
Bikas Saha
TEZ-776.6.A.patch
28/Apr/15 21:31
122 kB
Bikas Saha
TEZ-776.5.patch
28/Apr/15 17:36
117 kB
Bikas Saha
TEZ-776.4.patch
22/Apr/15 21:47
117 kB
Bikas Saha
TEZ-776.3.patch
17/Apr/15 21:38
117 kB
Bikas Saha
TEZ-776.2.patch
17/Apr/15 19:05
116 kB
Bikas Saha
TEZ-776.1.patch
09/Apr/15 01:14
117 kB
Bikas Saha
TEZ-776.ondemand.7.patch
16/Mar/15 03:50
109 kB
Bikas Saha
TEZ-776.ondemand.6.patch
13/Mar/15 06:30
120 kB
Bikas Saha
Without_patch_AM_CPU_Usage.png
09/Mar/15 13:55
63 kB
Rajesh Balamohan
With_Patch_AM_hotspots.png
09/Mar/15 13:52
485 kB
Rajesh Balamohan
With_Patch_AM_profile.png
09/Mar/15 13:52
472 kB
Rajesh Balamohan
with_patch_jmc_output_of_AM.png
09/Mar/15 13:06
388 kB
Rajesh Balamohan
without_patch_jmc_output_of_AM.png
09/Mar/15 13:06
294 kB
Rajesh Balamohan
TEZ-776.ondemand.5.patch
09/Mar/15 07:51
116 kB
Bikas Saha
TEZ-776.ondemand.4.patch
06/Mar/15 03:59
293 kB
Bikas Saha
TEZ-776.ondemand.3.patch
04/Mar/15 04:50
107 kB
Bikas Saha
TEZ-776.ondemand.2.patch
03/Mar/15 08:47
100 kB
Bikas Saha
TEZ-776.ondemand.1.patch
25/Feb/15 03:02
79 kB
Bikas Saha
TEZ-776.ondemand.patch
20/Feb/15 07:48
69 kB
Bikas Saha
events-problem-solutions.txt
10/Feb/15 22:40
6 kB
Bikas Saha

Issue Links

relates to

TEZ-2411 Offload DataMovement event creation from the AM to the tasks

Open

Activity

People

Assignee:: Bikas Saha

Reporter:: Siddharth Seth

Votes:: 0 Vote for this issue

Watchers:: 10 Start watching this issue

Dates

Created:: 29/Jan/14 22:06

Updated:: 30/Jun/15 04:52

Resolved:: 07/May/15 22:49