[JCR-3282] Optimize usage of norms

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.5
• Component/s: indexing, jackrabbit-core
• Assignee: Alex Deparvu
• Reporter: Alex Deparvu
• Created: 28/Mar/12 14:37
• Updated: 03/Aug/12 08:31
• Resolved: 13/Apr/12 15:59

Description

There is a very significant potential for optimizing the size of the search index.

We have seen a case where there were multiple segments with about the same number of nodes (roughly 10 million), but the size on disk was very different.
One segment was 19 GB while all others where around 3 GB. The major difference was the number of fields indexed. The large segment had significantly more fields, which resulted in a large norms file.

We should go through our implementation and see where norms are really necessary and disable tracking of norms wherever possible.