[PIG-4866] Do not serialize PigContext in configuration to the backend - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.16.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

It increases the conf sizes and in Tez it is really worse as we have multiple copies of the conf in a task - inputs, outputs, edge, processor.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

PIG-4866-1.patch
11/Apr/16 23:19
46 kB
Rohini Palaniswamy

Issue Links

relates to

PIG-4844 Tez AM runs out of memory when vertex has high number of outputs

Closed

Activity

People

Assignee:: Rohini Palaniswamy

Reporter:: Rohini Palaniswamy

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 11/Apr/16 23:13

Updated:: 08/Jun/16 20:48

Resolved:: 14/Apr/16 23:10