because arrayCopys into null.
if you want a testcase i can yank it out of in-progress patch from SOLR-1657, but i think its obvious.
convert the rest of solr to use the new tokenstream API
Committed revision 891596.
Correcting Fix Version based on CHANGES.txt, see this thread for more details...
Committed revision 949471.
merged to branch-1.4 for 1.4.1