Details
-
Improvement
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
-
Patch
Description
Pig Python UDFs currently perform deep copies on Bags converting them into Jython PyLists. This can cause Jython UDFs to run out of memory and fail. A Jython DataBag which extends PyList could allow for iterative access to DataBag elements, while only performing a deep copy when necessary.