Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1503

Configuration properties not in sync between FetcherReducer and nutch-default.xml

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.1
    • Fix Version/s: 2.2
    • Component/s: fetcher
    • Labels:
      None
    • Patch Info:
      Patch Available

      Description

      FetcherReducer.java

      Bug: Following properties appear in FetcherReducer but not in nutch-default.xml

      290       useHostSettings = conf.getBoolean("fetcher.queue.use.host.settings", false);
      300       this.timelimit = conf.getLong("fetcher.timelimit", -1);
      450       this.byIP = conf.getBoolean("fetcher.threads.per.host.by.ip", true);
      698       timelimit = context.getConfiguration().getLong("fetcher.timelimit", -1); 
      

      Therefore they cannot be used properly in code execution and must be updated, removed and/or added to nutch-default.xml.
      Patch coming up just now.

        Attachments

        1. NUTCH-1503.patch
          2 kB
          Lewis John McGibbney
        2. NUTCH-1503v2.patch
          0.6 kB
          Lewis John McGibbney

          Activity

            People

            • Assignee:
              lewismc Lewis John McGibbney
              Reporter:
              lewismc Lewis John McGibbney
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: