[PIG-2918] Avoid Spillable bag overhead where possible

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11
• Assignee: Dmitriy V. Ryaboy
• Reporter: Dmitriy V. Ryaboy
• Created: 13/Sep/12 05:39
• Updated: 22/Feb/13 04:53
• Resolved: 15/Sep/12 02:45

Description

We use BagFactory.newDefaultBag() liberally, and pay a price – each such bag registers with the spillable memory manager, and if we allocate a lot of tiny bags, we wind up paying for maintaining and cleaning up the internal linked list of weak references.
In many cases, we know a-priori that the bags are smal, and should probably be creating non-spillable bags for those cases.