Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
0.23.0
-
None
-
None
-
None
Description
MapTask.java
if (combinerRunner == null || numSpills < minSpillsForCombine) { Merger.writeFile(kvIter, writer, reporter, job); } else { combineCollector.setWriter(writer); combinerRunner.combine(kvIter, combineCollector); } //close writer.close();
InputSampler.java
for(int i = 1; i < numPartitions; ++i) { int k = Math.round(stepSize * i); while (last >= k && comparator.compare(samples[last], samples[k]) == 0) { ++k; } writer.append(samples[k], nullValue); last = k; } writer.close();
The key flows have potential resource leaks.
JobSplitWriter.java
SplitMetaInfo[] info = writeNewSplits(conf, splits, out); out.close(); SplitMetaInfo[] info = writeOldSplits(splits, out); out.close();