[CAMEL-7584] XML-Aware Tokenizer failing with utf-8 multibyte characters

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.14.0
• Component/s: camel-core
• Estimated Complexity: Unknown
• Assignee: Akitoshi Yoshida
• Reporter: Akitoshi Yoshida
• Created: 07/Jul/14 16:18
• Updated: 08/Jul/14 08:55
• Resolved: 08/Jul/14 08:55

Description

There is some issue in the underlining Stax reader's getLocation().getCharOffset() when the input data is an InputStream to the stax reader.

This issue was brought up in the woodstox community. But I believe fixing it seems to be non trivial as woodstox internally uses char/Reader and keeps the offset value to the character sequence and not to the original input stream.

We change the tokenzer to pass java.io.Reader to the woodstox parser instead of passing java.io.InputStream directly.

Issue Links

• is part of: CAMEL-7468 Make xmlTokenizer more xml-aware so that it can handle more flexible structures