[ROL-934] Filter spiders from dayhits

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0
• Fix Version/s: 2.1
• Component/s: Installation & Configuration, Pings and Trackbacks
• Assignee: Anil Gangolli
• Reporter: Matthew Schmidt
• Created: 16/Dec/05 16:39
• Updated: 08/Jan/14 05:02
• Resolved: 18/Dec/05 17:53

Description

At JRoller, we've modified RefererFilter.java to check the user-agent and exclude certain spiders from the dayhits. Our list is currently anything with slurp, bot, or java in the user-agent. It helps to give a much better picture of the actual hits. The following lines were added to RefererFilter around line 77:

// Check the user agent, just ignore counts for dayhits.
String useragent = request.getHeader("User-Agent");
if (useragent != null && !"".equals(useragent) && useragent.indexOf("slurp") != -1 && useragent.indexOf("bot") != -1 && useragent.indexOf("java") != -1) {
if (mLogger.isDebugEnabled())

{ mLogger.debug("Ignoring request from user agent=" + useragent); }

} else {