Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1355

nutchgora Configure minimum throughput for fetcher

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • nutchgora
    • None
    • None
    • Patch Available

    Description

      Like trunk, nutchgora should also have a feature to configure the fetcher with a minimum throughput. (See NUTCH-1067 for the work done by Markus).

      It's implemented in almost the same way, except that the number of times throughput falls below threshold is measured sequentially. (The counter is reset when throughput is healthy again; this should work even better against temporary dips).

      Defaults to disabled. Will commit later today if there is no objection.

      Attachments

        1. NUTCH-1355.patch
          9 kB
          Ferdy

        Activity

          People

            Unassigned Unassigned
            ferdy.g Ferdy
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: