[VELOCITY-570] speed improvement of the tokenizer

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4, 1.5, 1.6
• Fix Version/s: 1.6
• Component/s: Engine
• Environment: Tested on FreeBSD 6.2-STABLE and Linux (Debian Etch) on i386.; Java: JDK 1.5
• Assignee: Unassigned
• Reporter: Ronald Klop
• Created: 16/Nov/07 15:52
• Updated: 15/Aug/08 18:52
• Resolved: 15/Aug/08 18:52

Description

On some large templates (1-4MB) velocity gets very slow. I used JProfiler and found a lot of time is spent in VelocityCharStream.ExpandBuff. It is doing a lot of System.arraycopy.
The problem is that the size of the buffer is increased linearly in stead of exponentialy.
I have made a patch which doubles the size of the buffer in stead of incrementing it with the same value.
In my tests and in JProfiler it is shown that a lot less time is spent in ExpandBuff.