[NUTCH-2858] urlnormalizer-protocol: URL port is lost during normalization

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.18
• Fix Version/s: 1.19
• Component/s: plugin, urlnormalizer
• Patch Info: Patch Available
• Assignee: Sebastian Nagel
• Reporter: Sebastian Nagel
• Created: 27/Mar/21 11:04
• Updated: 13/Mar/24 14:51
• Resolved: 06/Apr/21 14:52

Description

If a URL includes a port, e.g. http://example.com:8080/ or https://example.com:8443/, the port is removed when normalizing using the protocol-urlnormalizer.

Instead, if the port is set,

• the port should be kept as is and
• the protocol should be unchanged
  • keeping the port and changing the protocol might result in a connection failure
  • unlike the default port mappings (80 (http) <> 443 (https)), non-default port mappings (8080 <> 8443) are risky and unlikely to work on every server setup.

Issue Links

• links to: GitHub Pull Request #575