[VELOCITY-191] UnicodeFileResourceLoader for Win2k Notepad UTF-8 files

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.3.1
• Fix Version/s: 1.5
• Component/s: Engine
• Environment: Operating System: All; Platform: All
• Bugzilla Id: 21582
• Assignee: Henning Schmiedehausen
• Reporter: Whome
• Created: 15/Jul/03 02:35
• Updated: 06/Jun/12 10:52
• Resolved: 24/Jan/07 15:30

Description

[copypaste from velocity-user mailing list]
Date: Mon, 14 Jul 2003 01:52:11 -0700 (PDT)
From: mailmur <[e-mail]>
Subject: UnicodeFileResourceLoader to support Win2k Notepad UTF-8 files
Content-Type: text/plain; charset=us-ascii

I discovered, that files saved with Win2k Notepad UTF-8 format always generated
an extra ? character at the start of ISO-8859-1 output text.

This was due to lack of UTF8 BOM mark support in
InputStreamReader/OutputStreamWriter classes.

I then created a inputstream implementation to skip BOM mark to overcome this
bug.

Please, find here a source + testprogram to see it for yourself. I created
UnicodeFileResourceLoader to make all this transparent.
http://koti.mbnet.fi/akini/java/unicodereader/

I dont know what is the proper procedure to add this to Velocity core (if you
find this useful), but here it is. Feel free to change class package. Or is
this even the right list to announce such addition....

Here is a link to Sun bugparade about the UTF-8 BOM problem:
http://developer.java.sun.com/developer/bugParade/bugs/4508058.html

Issue Links

• is related to: VELOCITY-451 Do some investigation into UTF-16 and InputStream / Reader interfaces
• is related to: VELOCITY-229 Velocity templates should be able to specify their own encoding