[PIG-1219] Extra listStatus call to the namenode in WeightedRangePartitioner

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.6.0
• Fix Version/s: 0.6.0
• Component/s: impl
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 03/Feb/10 19:29
• Updated: 05/Feb/10 22:07
• Resolved: 05/Feb/10 22:07

Description

We call FileLocalizer.openDFSFile in WeightedRangePartitioner to open quantile file. openDFSFile internally will check the existence of the quantile file, which adds burden to hdfs namenode. We shall remove this extra check.