Uploaded image for project: 'Nutch'
  1. Nutch
  2. NUTCH-430

integer overflow in HashComparator.compare

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1, 0.9.0
    • Fix Version/s: 0.9.0
    • Component/s: generator
    • Labels:
      None

      Description

      There's a integer overflow problem in HashComparator wich leads to fetchlist not to be sorted properly by hash of url. This leads to slower fetching speeds if there are many urls from same host as they are not evenly distributed.

        Attachments

          Activity

            People

            • Assignee:
              siren Sami Siren
              Reporter:
              siren Sami Siren
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: