Uploaded image for project: 'ManifoldCF'
  1. ManifoldCF
  2. CONNECTORS-1567

export of web connection bandwidth throttling

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • ManifoldCF 2.11, ManifoldCF 2.12
    • ManifoldCF 2.13
    • Web connector
    • None

    Description

      When exporting the web connector using the API, it doesn't export the bandwidth throttling.
      Than when importing this connector to a clean manifoldcf it creates the connector with basic bandwidth.
      When using the connector in a job it works properly.

      The issue here is that the connector isn't created with correct bandwidth throttling.
      And the connector gives issues in the UI when trying to view or edit.

      (related to issue: CONNECTORS-1568)

      e.g.:

      {
        "name": "test_web",
        "configuration": null,
          "_PARAMETER_": [
            {
              "_attribute_name": "Email address",
              "_value_": "tim.steenbeke@formica.digital"
            },
            {
              "_attribute_name": "Robots usage",
              "_value_": "all"
            },
            {
              "_attribute_name": "Meta robots tags usage",
              "_value_": "all"
            },
            {
              "_attribute_name": "Proxy host",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy port",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy authentication domain",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy authentication user name",
              "_value_": ""
            },
            {
              "_attribute_name": "Proxy authentication password",
              "_value_": ""
            }
          ]
        },
        "description": "Website repository standard settup",
        "throttle": null,
        "max_connections": 10,
        "class_name": "org.apache.manifoldcf.crawler.connectors.webcrawler.WebcrawlerConnector",
        "acl_authority": null
      }

      Attachments

        1. bandwidth_test_abc.png
          38 kB
          Tim Steenbeke

        Activity

          People

            kwright@metacarta.com Karl Wright
            SteenTi Tim Steenbeke
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: