Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: nutchgora
    • Fix Version/s: nutchgora
    • Component/s: fetcher
    • Labels:
      None

      Description

      Pass -numTasks N from crawler to FetcherJob

        Activity

        Hide
        Hudson added a comment -

        Integrated in Nutch-nutchgora #185 (See https://builds.apache.org/job/Nutch-nutchgora/185/)
        NUTCH-1298 Pass numTasks to FetcherJob (Revision 1297388)

        Result = SUCCESS
        ferdy :
        Files :

        • /nutch/branches/nutchgora/CHANGES.txt
        • /nutch/branches/nutchgora/src/java/org/apache/nutch/crawl/Crawler.java
        Show
        Hudson added a comment - Integrated in Nutch-nutchgora #185 (See https://builds.apache.org/job/Nutch-nutchgora/185/ ) NUTCH-1298 Pass numTasks to FetcherJob (Revision 1297388) Result = SUCCESS ferdy : Files : /nutch/branches/nutchgora/CHANGES.txt /nutch/branches/nutchgora/src/java/org/apache/nutch/crawl/Crawler.java
        Hide
        Ferdy Galema added a comment -

        I'm not certain what the status and support of the Crawler command is.. I think most are in favor of shell scripts. This is what I prefer too. I just tried the Crawler command and it seems that there are some other issues with it. For example at first sight it seems that the Generator is not called?

        Anyway, your patch addresses an issue and if the command is still used, why not commit it? I verified the patch and committed it. Thanks.

        Show
        Ferdy Galema added a comment - I'm not certain what the status and support of the Crawler command is.. I think most are in favor of shell scripts. This is what I prefer too. I just tried the Crawler command and it seems that there are some other issues with it. For example at first sight it seems that the Generator is not called? Anyway, your patch addresses an issue and if the command is still used, why not commit it? I verified the patch and committed it. Thanks.

          People

          • Assignee:
            Unassigned
            Reporter:
            Dan Rosher
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development