Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1391

readdb -stats fires java.io.EOFException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: nutchgora
    • Fix Version/s: nutchgora
    • Component/s: crawldb
    • Labels:
      None

      Description

      This is confirmed to be the case with both HBase and Cassandra v1.1.1

      lewis@lewis:~/ASF/nutchgora/runtime/local$ ./bin/nutch readdb -stats
      WebTable statistics start
      WebTableReader: java.io.EOFException
      at java.io.DataInputStream.readFully(DataInputStream.java:180)
      at java.io.DataInputStream.readFully(DataInputStream.java:152)
      at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
      at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
      at org.apache.hadoop.mapred.SequenceFileOutputFormat.getReaders(SequenceFileOutputFormat.java:89)
      at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:537)
      at org.apache.nutch.crawl.WebTableReader.processStatJob(WebTableReader.java:218)
      at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:479)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.nutch.crawl.WebTableReader.main(WebTableReader.java:412)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lewismc Lewis John McGibbney
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: