It seems to take 2 minutes and 45 seconds to run a single test with the latest build design and the test itself is only 4 seconds. I've noticed this for a long time, and it seems because ant is running through a billion targets first.
I haven't checked yet, so maybe it's a Solr specific issue? I'll check with Lucene and move this issue if necessary.
There is hopefully something we can do to improve this though. At least we should try and get some sharp minds to take first / second look. If I did not use an IDE so much to run tests, this would drive me nuts.