[LUCENE-5456] The demo run under the smoke tester OOMs on OS X

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Not A Problem
• Component/s: general/build
• Lucene Fields: New
• Assignee: Steven Rowe
• Reporter: Steven Rowe
• Created: 19/Feb/14 15:47
• Updated: 28/Aug/22 14:00
• Resolved: 20/Apr/17 19:11

Description

When running the smoke tester for the 4.7 RC1, I got an OOM when the demo's IndexFiles was run:

[...]
  unpack lucene-4.7.0.tgz...
    verify JAR metadata/identity/no javax.* or java.* classes...
    test demo with 1.6...
      got 5653 hits for query "lucene"
    test demo with 1.7...

command "export JAVA_HOME="/Library/Java/JavaVirtualMachines/jdk1.7.0_25.jdk/Contents/Home" PATH="/Library/Java/JavaVirtualMachines/jdk1.7.0_25.jdk/Contents/Home/bin:$PATH" JAVACMD="/Library/Java/JavaVirtualMachines/jdk1.7.0_25.jdk/Contents/Home/bin/java"; java -cp "core/lucene-core-4.7.0.jar:demo/lucene-demo-4.7.0.jar:analysis/common/lucene-analyzers-common-4.7.0.jar:queryparser/lucene-queryparser-4.7.0.jar" org.apache.lucene.demo.IndexFiles -index index -docs docs" failed:
Indexing to directory 'index'...
adding docs/analyzers-common/allclasses-frame.html
[...]
adding docs/core/org/apache/lucene/index/class-use/Term.html
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
	at org.apache.lucene.util.ByteBlockPool$DirectTrackingAllocator.getByteBlock(ByteBlockPool.java:103)
	at org.apache.lucene.util.ByteBlockPool.nextBuffer(ByteBlockPool.java:202)
	at org.apache.lucene.util.ByteBlockPool.allocSlice(ByteBlockPool.java:257)
	at org.apache.lucene.index.TermsHashPerField.writeByte(TermsHashPerField.java:252)
	at org.apache.lucene.index.TermsHashPerField.writeVInt(TermsHashPerField.java:273)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.writeProx(FreqProxTermsWriterPerField.java:145)
	at org.apache.lucene.index.FreqProxTermsWriterPerField.addTerm(FreqProxTermsWriterPerField.java:239)
	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:235)
	at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:171)
	at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:248)
	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253)
	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:453)
	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1529)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1199)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1180)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:199)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:155)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:155)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:155)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:155)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:155)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:155)
	at org.apache.lucene.demo.IndexFiles.indexDocs(IndexFiles.java:155)
	at org.apache.lucene.demo.IndexFiles.main(IndexFiles.java:110)


Traceback (most recent call last):
  File "dev-tools/scripts/smokeTestRelease.py", line 1377, in <module>
  File "dev-tools/scripts/smokeTestRelease.py", line 1321, in main
  File "dev-tools/scripts/smokeTestRelease.py", line 1358, in smokeTest
  File "dev-tools/scripts/smokeTestRelease.py", line 635, in unpackAndVerify
  File "dev-tools/scripts/smokeTestRelease.py", line 785, in verifyUnpacked
  File "dev-tools/scripts/smokeTestRelease.py", line 961, in testDemo
  File "dev-tools/scripts/smokeTestRelease.py", line 560, in run
RuntimeError: command "export JAVA_HOME="/Library/Java/JavaVirtualMachines/jdk1.7.0_25.jdk/Contents/Home" PATH="/Library/Java/JavaVirtualMachines/jdk1.7.0_25.jdk/Contents/Home/bin:$PATH" JAVACMD="/Library/Java/JavaVirtualMachines/jdk1.7.0_25.jdk/Contents/Home/bin/java"; java -cp "core/lucene-core-4.7.0.jar:demo/lucene-demo-4.7.0.jar:analysis/common/lucene-analyzers-common-4.7.0.jar:queryparser/lucene-queryparser-4.7.0.jar" org.apache.lucene.demo.IndexFiles -index index -docs docs" failed; see log file /Users/sarowe/temp/smoke_test_4_7/unpack/lucene-4.7.0/index.log