[TRINIDAD-1948] Trinidad's Agent API Should Support Detection of Web Crawlers

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-beta-1
• Fix Version/s: 2.0.0-beta-1
• Assignee: Max Starets
• Reporter: Max Starets
• Created: 28/Oct/10 21:00
• Updated: 29/Oct/10 20:00
• Resolved: 29/Oct/10 20:00

Description

We should add support for detecting web crawlers at runtime. This would allow page authors to generate special content for the search engines, and would enable us in the future to implement a special rendering mode if we choose to do so.

Proposal:

• Add new TYPE_WEBCRAWLER Agent type
• Add AGENT_GOOGLEBOT and AGENT_MSNBOT agents
• Use the desktop rendering kit and the default output mode when generating content for web crawlers (for now).