[NUTCH-1533] Implement getPrevModifiedTime(), setPrevModifiedTime(), getBatchId() and setBatchId() accessors in o.a.n.storage.WebPage

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1
• Fix Version/s: 2.2
• Component/s: storage
• Assignee: lufeng
• Reporter: Lewis John McGibbney
• Created: 16/Feb/13 05:05
• Updated: 22/May/13 03:54
• Resolved: 25/Mar/13 12:33

Description

NUTCH-1532 needs to obtain a batchId to add to NutchDocument prior to indexing. This is currently not available as we do not store the information in the WebPage. Additionally, we do not store the other ModifiedTime's but incorrectly set them in o.a.n.crawl.FetchSchedule#setFetchSchedule.
All the above accessors should be implemented.

Issue Links

• blocks: NUTCH-1532 Replace 'segment' mapping field with batchId