[PIG-2693] LoadFunc.setLocation should be called before LoadMetadata.getStatistics

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11
• Assignee: William W. Graham Jr
• Reporter: William W. Graham Jr
• Created: 10/May/12 22:53
• Updated: 22/Feb/13 04:53
• Resolved: 18/May/12 21:21

Description

We ran into a bug with Pig/HCatalog integration on the trunk. The issue is that JobControlCompiler calls the adjustNumReducers method just before it calls setLocation on all of the LoadFuncs. This causes problems, since some loaders (i.e., HCatLoader) need setLocation to be called before it can respond to getStatistics with it's data size.