[NUTCH-2571] SegmentReader -list fails to read segment

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.15
• Fix Version/s: 1.15
• Component/s: segment

Environment

local + pseudo-distributed mode

• Assignee: Sebastian Nagel
• Reporter: Sebastian Nagel
• Created: 23/Apr/18 11:25
• Updated: 01/Oct/19 14:29
• Resolved: 26/Apr/18 11:16

Description

The -list command of SegmentReader fails to read data from segments:

% bin/nutch readseg -list crawl/segments/20180409100315/ 
Exception in thread "main" java.io.IOException: wrong value class:  is not class org.apache.nutch.crawl.CrawlDatum
        at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2379)
        at org.apache.nutch.segment.SegmentReader.getStats(SegmentReader.java:524)
        at org.apache.nutch.segment.SegmentReader.list(SegmentReader.java:482)
        at org.apache.nutch.segment.SegmentReader.run(SegmentReader.java:670)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.nutch.segment.SegmentReader.main(SegmentReader.java:736)

Issue Links

• is caused by: NUTCH-2375 Upgrade the code base from org.apache.hadoop.mapred to org.apache.hadoop.mapreduce
• links to: GitHub Pull Request #325