Uploaded image for project: 'ManifoldCF'
  1. ManifoldCF
  2. CONNECTORS-1567

export of web connection bandwidth throttling

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: ManifoldCF 2.11, ManifoldCF 2.12
    • Fix Version/s: ManifoldCF 2.13
    • Component/s: Web connector
    • Labels:
      None

      Description

      When exporting the web connector using the API, it doesn't export the bandwidth throttling.
      Than when importing this connector to a clean manifoldcf it creates the connector with basic bandwidth.
      When using the connector in a job it works properly.

      The issue here is that the connector isn't created with correct bandwidth throttling.
      And the connector gives issues in the UI when trying to view or edit.

      (related to issue: CONNECTORS-1568)

      e.g.:

      {
        "name": "test_web",
        "configuration": null,
          "_PARAMETER_": [
            {
              "_attribute_name": "Email address",
              "_value_": "tim.steenbeke@formica.digital"
            },
            {
              "_attribute_name": "Robots usage",
              "_value_": "all"
            },
            {
              "_attribute_name": "Meta robots tags usage",
              "_value_": "all"
            },
            {
              "_attribute_name": "Proxy host",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy port",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy authentication domain",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy authentication user name",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy authentication password",
              "_value_": ""
            }
          ]
        },
        "description": "Website repository standard settup",
        "throttle": null,
        "max_connections": 10,
        "class_name": "org.apache.manifoldcf.crawler.connectors.webcrawler.WebcrawlerConnector",
        "acl_authority": null
      }

        Attachments

        1. bandwidth_test_abc.png
          38 kB
          Tim Steenbeke

          Activity

            People

            • Assignee:
              kwright@metacarta.com Karl Wright
              Reporter:
              SteenTi Tim Steenbeke
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: