[SOLR-14911] Logger : UpdateLog Error Message : java.io.EOFException

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Invalid
• Affects Version/s: 7.5
• Component/s: SolrCLI
• Assignee: Unassigned
• Reporter: D
• Created: 02/Oct/20 18:08
• Updated: 09/Oct/20 15:52
• Resolved: 02/Oct/20 18:22

Description

Events:

1. GC logs showing continuos Full GC events. Log report attached.
2. Core filling failed , showing less data than expected.
3. following warnings showing on dashboard before error.

Level	Logger	Message
WARN false	ManagedIndexSchemaFactory	The schema has been upgraded to managed,​ but the non-managed schema schema.xml is still loadable. PLEASE REMOVE THIS FILE.
WARN false	ManagedIndexSchemaFactory	The schema has been upgraded to managed,​ but the non-managed schema schema.xml is still loadable. PLEASE REMOVE THIS FILE.
WARN false	SolrResourceLoader	Solr loaded a deprecated plugin/analysis class [solr.TrieDateField]. Please consult documentation how to replace it accordingly.
WARN false	ManagedIndexSchemaFactory	The schema has been upgraded to managed,​ but the non-managed schema schema.xml is still loadable. PLEASE REMOVE THIS FILE.
WARN false	UpdateLog	Starting log replay tlog{file=........\data\tlog\tlog.0000000000000445482 refcount=2} active=false starting pos=0 inSortedOrder=false

• Total data in all cores around 8 GB
• Other Configurations:
  • -XX:+UseG1GC
  • -XX:+UseStringDeduplication
  • -XX:MaxGCPauseMillis=500
  • -Xms15g
  • -Xmx15g
  • -Xss256k
• OS Environment :
  • Windows 10,
  • Filling cores by calling SQL query using jtds-1.3.1 library.
  • Solr Version 7.5
  • Runtime: Oracle Corporation OpenJDK 64-Bit Server VM 11.0.2 11.0.2+9
  • Processors : 48
  • System Physical Memory : 128 GB
  • Swap Space : 256GB
• solr-spec7.5.0
  • solr-impl7.5.0 b5bf70b7e32d7ddd9742cc821d471c5fabd4e3df - jimczi - 2018-09-18 13:07:55
• lucene-spec7.5.0
  • lucene-impl7.5.0 b5bf70b7e32d7ddd9742cc821d471c5fabd4e3df - jimczi - 2018-09-18 13:01:1

Error Message : 

java.io.EOFException
at org.apache.solr.common.util.FastInputStream.readFully(FastInputStream.java:168)
at org.apache.solr.common.util.JavaBinCodec.readStr(JavaBinCodec.java:863)
at org.apache.solr.common.util.JavaBinCodec.readStr(JavaBinCodec.java:857)
at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:266)
at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:256)
at org.apache.solr.common.util.JavaBinCodec.readSolrInputDocument(JavaBinCodec.java:603)
at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:315)
at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:256)
at org.apache.solr.common.util.JavaBinCodec.readArray(JavaBinCodec.java:747)
at org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:272)
at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:256)
at org.apache.solr.update.TransactionLog$LogReader.next(TransactionLog.java:673)
at org.apache.solr.update.UpdateLog$LogReplayer.doReplay(UpdateLog.java:1832)
at org.apache.solr.update.UpdateLog$LogReplayer.run(UpdateLog.java:1747)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)