[LUCENE-4342] Issues with prefix tree's Distance Error Percentage

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0-ALPHA, 4.0-BETA
• Fix Version/s: 4.0
• Component/s: modules/spatial
• Lucene Fields: New
• Assignee: David Smiley
• Reporter: Itamar Syn-Hershko
• Created: 29/Aug/12 20:39
• Updated: 28/Aug/22 13:25
• Resolved: 31/Aug/12 17:55

Description

See attached patch for a failing test

Basically, it's a simple point and radius scenario that works great as long as args.setDistPrecision(0.0); is called. Once the default precision is used (2.5%), it doesn't work as expected.

The distance between the 2 points in the patch is 35.75 KM. Taking into account the 2.5% error the effective radius without false negatives/positives should be around 34.8 KM. This test fails with a radius of 33 KM.