Affects Version/s: None
Fix Version/s: 0.1.0
Currently, on spill pig can generate millions of small (under 128K) files. Partially this is due to
PIG-170 but even with that patch, you can still try and spill small bags.
The proposal is to not spill small files. Alan told me that the logic is already there but we just need to bump the size limit.
|Resolution||Fixed [ 1 ]|
|Status||Open [ 1 ]||Resolved [ 5 ]|
|Fix Version/s||0.1.0 [ 12312848 ]|
|Status||Resolved [ 5 ]||Closed [ 6 ]|