Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-2785

FreeGenerator: command-line option to define number of generated fetch lists

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.16
    • Fix Version/s: 1.17
    • Component/s: generator
    • Labels:
      None
    • Patch Info:
      Patch Available

      Description

      While Generator allows to specify the number of generated fetch lists using the "-numFetchers" command-line option, FreeGenerator does not provide such an option. It uses the value of "mapreduce.job.maps" (2 by default), also in local mode where Generator always creates only one single fetch list.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                snagel Sebastian Nagel
                Reporter:
                snagel Sebastian Nagel
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: