[NUTCH-3000] protocol-selenium returns only the body,strips off the <head/> element

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.20
• Component/s: protocol
• Assignee: Unassigned
• Reporter: Tim Allison
• Created: 13/Sep/23 13:52
• Updated: 13/Mar/24 14:51
• Resolved: 13/Sep/23 18:58

Description

The selenium protocol returns only the body portion of the html, which means that neither the title nor the other page metadata in the <head/> section gets extracted.

String innerHtml = driver.findElement(By.tagName("body"))
                        .getAttribute("innerHTML");

We should return the full html, no?

Issue Links

• links to: GitHub Pull Request #773