[NUTCH-1998] Add support for user-defined file extension to CommonCrawlDataDumper

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.11
• Component/s: tool
• Labels: memex patch
• Assignee: Chris A. Mattmann
• Reporter: Giuseppe Totaro
• Created: 22/Apr/15 18:40
• Updated: 13/Mar/24 14:50
• Resolved: 11/May/15 21:07

Description

CommonCrawlDataDumper tool is able to generate CBOR-encoded files, extracted from Nutch crawled data, using the Common Crawl format. By default, CommonCrawlDataDumper uses the original file extension.
We are going to add support for a command-line option (e.g., -extension) that allows the user to provide a file extension to use in place of the original one.

Issue Links

• is related to: TIKA-1610 CBOR Parser and detection [improvement]