Uploaded image for project: 'ManifoldCF'
  1. ManifoldCF
  2. CONNECTORS-496

Test needed for MySQL that exercises hopcount filtering during a load test

    XMLWordPrintableJSON

    Details

    • Type: Test
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: ManifoldCF 0.6
    • Fix Version/s: ManifoldCF 1.0
    • Component/s: Framework core
    • Labels:
      None

      Description

      User reports that ManifoldCF web crawls run on MySQL fail to find the correct number of documents, compared to web crawls run on PostgreSQL. The documents included differ from run to run. We need a test that duplicates the appropriate environment. >12000 documents, hop-count filtering enabled.

      > - Max Hop on Links: 15
      > - Max Hop on Redirects: 10
      > - Include only hosts matching seeds: Checked
      > - org.apache.manifoldcf.crawler.threads: 50
      > - org.apache.manifoldcf.database.maxhandles: 100

        Attachments

          Activity

            People

            • Assignee:
              kwright@metacarta.com Karl Wright
              Reporter:
              kwright@metacarta.com Karl Wright
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: