In LUCENE-1888, we enabled indexing payloads into term vectors, but
the highlighter APIs that "reconstruct" a token stream from term
vectors fail to plumb through the payloads if they were indexed.
Commit 1557445 from Michael McCandless in branch 'dev/branches/lucene_solr_4_6'
[ https://svn.apache.org/r1557445 ]
LUCENE-5394: Fix TokenSources.getTokenStream to return payloads if they were indexed with term vectors
Commit 1557442 from Michael McCandless in branch 'dev/branches/branch_4x'
[ https://svn.apache.org/r1557442 ]
Commit 1557439 from Michael McCandless in branch 'dev/trunk'
[ https://svn.apache.org/r1557439 ]
Looks OK. Although I hate that this code still uses Token class. But that is unrelated.
Patch, I think it's ready. I'll commit soon.