Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-6073

Fix directory deletion in ExtractReuters, recover from errors

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: modules/benchmark
    • Labels:
      None
    • Lucene Fields:
      New, Patch Available

      Description

      ExtractReuters in the benchmark module currently fails because it currently creates the output directory, and then calls IOUtils.rm on it (which will remove all files in it as well as removes the output directory itself). This is to fix this behaviour.

      While I was at it, I also added a bit more logging in case of file errors (the download I had some bad data) and made the task recover in case of issues with one file.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              andyetitmoves Ramkumar Aiyengar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: