Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-1503

Configuration properties not in sync between FetcherReducer and nutch-default.xml

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.1
    • 2.2
    • fetcher
    • None
    • Patch Available

    Description

      FetcherReducer.java

      Bug: Following properties appear in FetcherReducer but not in nutch-default.xml

      290       useHostSettings = conf.getBoolean("fetcher.queue.use.host.settings", false);
      300       this.timelimit = conf.getLong("fetcher.timelimit", -1);
      450       this.byIP = conf.getBoolean("fetcher.threads.per.host.by.ip", true);
      698       timelimit = context.getConfiguration().getLong("fetcher.timelimit", -1); 
      

      Therefore they cannot be used properly in code execution and must be updated, removed and/or added to nutch-default.xml.
      Patch coming up just now.

      Attachments

        1. NUTCH-1503.patch
          2 kB
          Lewis John McGibbney
        2. NUTCH-1503v2.patch
          0.6 kB
          Lewis John McGibbney

        Activity

          People

            lewismc Lewis John McGibbney
            lewismc Lewis John McGibbney
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: