Details
-
Improvement
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
None
-
None
Description
With StrTokenizer at present you cannot extract the separators between the tokens, a feature which is possible with StringTokenizer.
Thus tokenizing "a.b@c.d" using ".@" would return a,b,c,d but you wouldn't know where the @ was.
This could probably best be part of the API as a lastSeparator() method that can only be called after next(), returning the separator(s) between that token and the previous token.