[PIG-2616] JobControlCompiler.getInputSizeFromLoader must handle exceptions from LoadFunc.getStatistics.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11
• Assignee: William W. Graham Jr
• Reporter: William W. Graham Jr
• Created: 26/Mar/12 04:43
• Updated: 22/Feb/13 04:54
• Resolved: 26/Apr/12 22:50

Description

PIG-2573 made it possible for JobControlCompiler to get input size from LoadFuncs, but in some cases (i.e. InterStorage), getStatistics throws an exception:

Caused by: java.lang.UnsupportedOperationException
        at org.apache.pig.impl.io.InterStorage.getStatistics(InterStorage.java:189)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getInputSizeFromLoader(JobControlCompiler.java:839)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getInputSize(JobControlCompiler.java:799)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.estimateNumberOfReducers(JobControlCompiler.java:777)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:599)