Nutch
  1. Nutch
  2. NUTCH-1332

db.max.outlinks.per.page not honored

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Not a Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In the WebGraph i spotted records with > db.max.outlinks.per.page outlinks. Somewhere down the line this setting is not honored.

        Activity

        Hide
        Markus Jelsma added a comment -

        This was caused by feeding multiple segments of which some accidentally contained fetched duplicates.

        Show
        Markus Jelsma added a comment - This was caused by feeding multiple segments of which some accidentally contained fetched duplicates.

          People

          • Assignee:
            Unassigned
            Reporter:
            Markus Jelsma
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development