[LUCENE-9191] Fix linefiledocs compression or replace in tests

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 8.6
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Robert Muir
• Created: 28/Jan/20 16:50
• Updated: 28/Aug/22 15:57
• Resolved: 06/Jul/20 10:45

Description

LineFileDocs(random) is very slow, even to open. It does a very slow "random skip" through a gzip compressed file.

For the analyzers tests, in LUCENE-9186 I simply removed its usage, since TestUtil.randomAnalysisString is superior, and fast. But we should address other tests using it, since LineFileDocs(random) is slow!

I think it is also the case that every lucene test has probably tested every LineFileDocs line many times now, whereas randomAnalysisString will invent new ones.

Alternatively, we could "fix" LineFileDocs(random), e.g. special compression options (in blocks)... deflate supports such stuff. But it would make it even hairier than it is now.