Currently, tests get a random seed, and several possibilities can be randomly assigned, or fixed to
specific values with -Dtests.codec or -Dtests.directory.
The default values for these sort of things is 'random'.
I think it would be a great improvement if we:
- improved our code here so that we always consume the same amount from the Random. this means for example, if you specific -Dtests.directory=RAMDirectory, we should consume a wasted int, where we would normally pick one from random.
- in 3.x, i think its worth it to actually consume wasted ints where 4.0 picks the codec.
With these changes, you could ideally (in many situations situations)
- take a failure and modify parameters to see if its specific to a particular codec or directory, or a general problem
- take a failure from trunk and see if it affects 3.x