[NUTCH-2478] // is not a valid base URL

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13
• Fix Version/s: 1.14
• Assignee: Markus Jelsma
• Reporter: Markus Jelsma
• Created: 12/Dec/17 15:51
• Updated: 18/Dec/17 16:53
• Resolved: 17/Dec/17 11:34

Description

This test fails:

  @Test
  public void testBadResolver() throws Exception {
    URL base = new URL("//www.example.org/");
    String target = "index/produkt/kanaly/";
    
    URL abs = URLUtil.resolveURL(base, target);
    Assert.assertEquals("http://www.example.org/index/produkt/kanaly/", abs.toString());
  }

and has to fail because of invalid base URL, so the current URL is used. If current URL is not /, its path will be prepended, resulting in 404 being crawled.

This ticket must allow // as base, and resolve the protocol.

Issue Links

• links to: GitHub Pull Request #263
• links to: GitHub Pull Request #263