[LUCENE-6073] Fix directory deletion in ExtractReuters, recover from errors

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: modules/benchmark
• Lucene Fields: New, Patch Available
• Assignee: Unassigned
• Reporter: Ramkumar Aiyengar
• Created: 23/Nov/14 13:23
• Updated: 28/Aug/22 14:20

Description

ExtractReuters in the benchmark module currently fails because it currently creates the output directory, and then calls IOUtils.rm on it (which will remove all files in it as well as removes the output directory itself). This is to fix this behaviour.

While I was at it, I also added a bit more logging in case of file errors (the download I had some bad data) and made the task recover in case of issues with one file.