[NUTCH-2241] Unstable Selenium plugin in Nutch. Fixed bugs and enhanced configuration

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.12
• Fix Version/s: 1.12
• Component/s: plugin, protocol
• Labels: firefox interactiveselenium lib-selenium memex nutch nutch-default.xml plugin protocol selenium

Environment

Fixed for Firefox browser with version 25 and above.

• Flags: Important
• Assignee: Chris A. Mattmann
• Reporter: Karanjeet Singh
• Created: 19/Mar/16 23:21
• Updated: 13/Mar/24 14:51
• Resolved: 20/Mar/16 00:43

Description

Issues:
(a) Firefox browser doesn't close gracefully.
(b) The property libselenium.page.load.delay is not working. No matter how much delay you give, the driver is not waiting for the page to load.
(c) There is no timeout configured for the firefox binary.
(d) A lot of selenium configuration is hard-coded which can be exposed through nutch-default.xml or nutch-site.xml

All these issues are part of "lib-selenium" plugin which is being used by two other protocols "protocol-selenium" and "protocol-interactiveselenium".