Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-471

RowSimilarityJob-Mapper-EntriesToVectorsReducer failure

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Not A Problem
    • 0.4
    • 0.4
    • None
    • None

    Description

      I used Boolean Data and SIMILARITY_TANIMOTO_COEFFICIENT

      java.io.IOException: Task: attempt_201008101359_0084_r_000000_0 - The reduce copier failed
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:380)
      at org.apache.hadoop.mapred.Child.main(Child.java:170)
      Caused by: java.io.IOException: Intermediate merge failed
      at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$InMemFSMergeThread.doInMemMerge(ReduceTask.java:2576)
      at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$InMemFSMergeThread.run(ReduceTask.java:2501)
      Caused by: java.lang.RuntimeException: java.io.EOFException
      at org.apache.hadoop.io.WritableComparator.compare(WritableComparator.java:103)
      at org.apache.hadoop.mapred.Merger$MergeQueue.lessThan(Merger.java:373)
      at org.apache.hadoop.util.PriorityQueue.upHeap(PriorityQueue.java:123)
      at org.apache.hadoop.util.PriorityQueue.put(PriorityQueue.java:50)
      at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:447)
      at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:381)
      at org.apache.hadoop.mapred.Merger.merge(Merger.java:107)
      at org.apache.hadoop.mapred.Merger.merge(Merger.java:93)
      at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$InMemFSMergeThread.doInMemMerge(ReduceTask.java:2551)
      ... 1 more
      Caused by: java.io.EOFException
      at java.io.DataInputStream.readByte(DataInputStream.java:250)
      at org.apache.mahout.math.Varint.readUnsignedVarInt(Varint.java:159)
      at org.apache.mahout.math.Varint.readSignedVarInt(Varint.java:140)
      at org.apache.mahout.math.hadoop.similarity.SimilarityMatrixEntryKey.readFields(SimilarityMatrixEntryKey.java:65)
      at org.apache.hadoop.io.WritableComparator.compare(WritableComparator.java:97)
      ... 9 more

      Attachments

        Activity

          People

            Unassigned Unassigned
            huiwenhan Han Hui Wen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: