[PIG-5338] Prevent deep copy of DataBag into Jython List - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Patch Available
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Flags:

Patch

Description

Pig Python UDFs currently perform deep copies on Bags converting them into Jython PyLists. This can cause Jython UDFs to run out of memory and fail. A Jython DataBag which extends PyList could allow for iterative access to DataBag elements, while only performing a deep copy when necessary.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

PIG-5338.patch
15/Apr/18 20:43
15 kB
Greg Phillips
PIG-5338.001.patch
26/Apr/18 15:47
16 kB
Greg Phillips

Activity

People

Assignee:: Greg Phillips

Reporter:: Greg Phillips

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 12/Apr/18 13:51

Updated:: 13/Jun/18 15:48