Nutch
  1. Nutch
  2. NUTCH-283

If the Fetcher times out and abandons Fetcher Threads, severe errors will occur on those Threads

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.8
    • Fix Version/s: None
    • Component/s: fetcher
    • Labels:
      None

      Description

      If a Fetcher has chosen to time out and has abandoned outstanding Fetcher Threads, resources that those Fetcher Threads may be using are closed. This naturally causes any abandoned Fetcher Threads to fail when they later attempt to finish up their work in progress.

      I have a patch that addresses this that I am attaching.

      1. patch.txt
        1 kB
        Scott Ganyo
      2. patch.txt
        1 kB
        Scott Ganyo

        Activity

        Scott Ganyo created issue -
        Scott Ganyo made changes -
        Field Original Value New Value
        Attachment patch.txt [ 12334527 ]
        Hide
        Scott Ganyo added a comment -

        There was a typo in the earlier patch. This patch supersedes the first patch.

        Show
        Scott Ganyo added a comment - There was a typo in the earlier patch. This patch supersedes the first patch.
        Scott Ganyo made changes -
        Attachment patch.txt [ 12334787 ]
        Show
        Markus Jelsma added a comment - Bulk close of legacy issues: http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira
        Markus Jelsma made changes -
        Status Open [ 1 ] Closed [ 6 ]
        Resolution Won't Fix [ 2 ]

          People

          • Assignee:
            Unassigned
            Reporter:
            Scott Ganyo
          • Votes:
            1 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development