Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1392

-force and -resume arguments being ignored in ParserJob

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: nutchgora
    • Fix Version/s: nutchgora
    • Component/s: parser
    • Labels:
      None

      Description

      From the log below there is obviously something not right here as both -resume and -force are passed to the CLI but blatantly ignored within the log output.

      lewis@lewis:~/ASF/nutchgora/runtime/local$ ./bin/nutch parse
      Usage: ParserJob (<batchId> | -all) [-crawlId <id>] [-resume] [-force]
      <batchId> - symbolic batch ID created by Generator
      -crawlId <id> - the id to prefix the schemas to operate on,
      (default: storage.crawl.id)
      -all - consider pages from all crawl jobs
      -resume - resume a previous incomplete job
      -force - force re-parsing even if a page is already parsed
      lewis@lewis:~/ASF/nutchgora/runtime/local$ ./bin/nutch parse -all -resume -force
      ParserJob: starting
      ParserJob: resuming: false
      ParserJob: forced reparse: false
      ParserJob: parsing all
      Parsing http://www.trancearoundtheworld.com/
      ParserJob: success

        Attachments

        1. NUTCH-1392.patch
          2 kB
          Ferdy

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lewismc Lewis John McGibbney
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: