[TIKA-3146] Add Nutch's TextProfileSignature digest to tika-eval's text stats

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.25
• Assignee: Tim Allison
• Reporter: Tim Allison
• Created: 23/Jul/20 21:38
• Updated: 24/Jul/20 22:43
• Resolved: 24/Jul/20 21:21

Description

https://github.com/apache/nutch/blob/master/src/java/org/apache/nutch/crawl/TextProfileSignature

Will require trivial modifications to work within the tika-eval context. As with TIKA-3145, this will give users the ability to calculate a fuzzier digest to identify near duplicates.