[PIG-4730] [Pig on Tez] Total parallelism estimation does not account load parallelism - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.16.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Total parallelism estimation in ParallelismSetter which is used to auto increment AM size does not include parallelism of load vertices causing the estimation to be wrong and not incrementing AM memory in cases where it is needed leading to OOM.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

PIG-4730-1.patch
09/Nov/15 21:46
10 kB
Rohini Palaniswamy

Activity

People

Assignee:: Rohini Palaniswamy

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 09/Nov/15 20:47

Updated:: 08/Jun/16 20:48

Resolved:: 10/Nov/15 00:04