Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Using CollectBlocksMap (See also HAMA-150), We can collect the blocks to 'collectionTable' from HDFS files as describe below.
It would be nice if it added up the examples.
public static class MyMapper extends CollectBlocksBase implements
CollectBlocksMap<IntWritable, MapWritable> {
private MapWritable value;
@Override
public void map(IntWritable key, MapWritable value,
OutputCollector<BlockID, VectorWritable> output, Reporter reporter)
throws IOException {
int startColumn;
int endColumn;
int blkRow = key.get() / mBlockRowSize;
this.value = value;
int i = 0;
do
while (endColumn < (mColumns - 1));
}
private DenseVector subVector(int i0, int i1) {
DenseVector res = new DenseVector();
for (int i = i0; i <= i1; i++)
return res;
}
}