Thanks for opening this, Tom.

I've got some barebones filters for some of this stuff on my computer.
Because the ICU jar file is large, i was trying to see if i could solve LUCENE-2510 first, but this would only fix the problem for 4.0 anyway.
I think we should just make an icu contrib for now, and put the factories (Tokenizer, Normalizer, Folding, Transliterator, Collation) and the jar file in there.

actually another idea, would be to just make an 'extraAnalyzers' contrib.
then we could also add factories for smart chinese, polish etc, without creating a ton of contribs.

i think this would be a good solution to expose all the lucene analyzers to Solr,
since to me, LUCENE-2510 seems tricky.

here's a start: makes an analysis-extras contrib with all the build logic, and factories for the icu filters.

still todo: add support for custom normalization and custom tokenizer config, filters for smart chinese, and stempel.

But i think its ok to commit this as-is and improve it in svn.

ok, i committed the baseline code (rev 1030012, rev 1030022 in 3x).

we can keep the issue open and just add patches against it for customization, etc.
I just wanted to get all the build-system-stuff working so this was easy.

Thanks for committing the baseline code changes. Shall we close out this issue now then with any further changes to follow under a separate ticket, what do you think?