Solr
  1. Solr
  2. SOLR-7091

Data-driven schema and block-join style update requests don't play well together

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.3, 6.0
    • Component/s: None
    • Labels:
      None

      Description

      Tried to index the basic block-join example docs from the refguide (see link below) into the gettingstarted collection, which uses the data-driven schema configs:
      https://cwiki.apache.org/confluence/display/solr/Other+Parsers#OtherParsers-BlockJoinQueryParsers

      Here's the result:

      $ bin/post -c gettingstarted block-join/docs.xml 
      java -classpath dist/solr-core-6.0.0-SNAPSHOT.jar -Dauto=yes -Dc=gettingstarted -Ddata=files org.apache.solr.util.SimplePostTool block-join/docs.xml
      SimplePostTool version 5.0.0
      Posting files to [base] url http://localhost:8983/solr/gettingstarted/update...
      Entering auto mode. File endings considered are xml,json,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log
      POSTing file docs.xml (application/xml) to [base]
      SimplePostTool: WARNING: Solr returned an error #400 (Bad Request) for url: http://localhost:8983/solr/gettingstarted/update
      SimplePostTool: WARNING: Response: <?xml version="1.0" encoding="UTF-8"?>
      <response>
      <lst name="responseHeader"><int name="status">400</int><int name="QTime">429</int></lst><lst name="error"><str name="msg">undefined field: "comments"</str><int name="code">400</int></lst>
      </response>
      SimplePostTool: WARNING: IOException while reading response: java.io.IOException: Server returned HTTP response code: 400 for URL: http://localhost:8983/solr/gettingstarted/update
      1 files indexed.
      COMMITting Solr index changes to http://localhost:8983/solr/gettingstarted/update...
      Time spent: 0:00:00.481
      

      Logs from the leader are:

      INFO  - 2015-02-09 17:08:27.882; org.apache.solr.schema.ManagedIndexSchema; Persisted managed schema version 1 at /configs/gettingstarted/managed-schema
      ERROR - 2015-02-09 17:08:27.882; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:27.883; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      INFO  - 2015-02-09 17:08:27.882; org.apache.solr.schema.ZkIndexSchemaReader$1; A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/gettingstarted/managed-schema, has occurred - updating schema from ZooKeeper ...
      INFO  - 2015-02-09 17:08:27.882; org.apache.solr.schema.ZkIndexSchemaReader$1; A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/gettingstarted/managed-schema, has occurred - updating schema from ZooKeeper ...
      INFO  - 2015-02-09 17:08:27.884; org.apache.solr.schema.ZkIndexSchemaReader; Retrieved schema version 1 from ZooKeeper
      ERROR - 2015-02-09 17:08:27.891; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:27.892; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      ERROR - 2015-02-09 17:08:27.896; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:27.896; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      INFO  - 2015-02-09 17:08:27.896; org.apache.solr.schema.ZkIndexSchemaReader; Retrieved schema version 1 from ZooKeeper
      INFO  - 2015-02-09 17:08:27.947; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard1_replica2] webapp=/solr path=/update params={update.distrib=TOLEADER&update.chain=add-unknown-fields-to-the-schema&distrib.from=http://192.168.1.2:8983/solr/gettingstarted_shard2_replica2/&wt=javabin&version=2} {} 0 90
      ERROR - 2015-02-09 17:08:27.949; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments"
      	at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1221)
      	at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1338)
      	at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
      	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
      	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
      	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166)
      	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:935)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1089)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:701)
      	at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
      	at org.apache.solr.handler.loader.JavabinLoader$1.update(JavabinLoader.java:96)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:166)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readIterator(JavaBinUpdateRequestCodec.java:136)
      	at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:225)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readNamedList(JavaBinUpdateRequestCodec.java:121)
      	at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:190)
      	at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:116)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:173)
      	at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:106)
      	at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:58)
      	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
      	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
      	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
      	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2027)
      	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
      	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      	at org.eclipse.jetty.server.Server.handle(Server.java:497)
      	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:313)
      	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
      	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:626)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:546)
      	at java.lang.Thread.run(Thread.java:745)
      
      ERROR - 2015-02-09 17:08:27.952; org.apache.solr.update.StreamingSolrClients$1; error
      org.apache.solr.common.SolrException: Bad Request
      
      
      
      request: http://192.168.1.2:8983/solr/gettingstarted_shard1_replica2/update?update.chain=add-unknown-fields-to-the-schema&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F192.168.1.2%3A8983%2Fsolr%2Fgettingstarted_shard2_replica2%2F&wt=javabin&version=2
      	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:242)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      INFO  - 2015-02-09 17:08:28.242; org.apache.solr.schema.ZkIndexSchemaReader; Finished refreshing schema in 345 ms
      ERROR - 2015-02-09 17:08:28.247; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:28.247; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      INFO  - 2015-02-09 17:08:28.249; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard2_replica2] webapp=/solr path=/update params={} {add=[1]} 0 429
      ERROR - 2015-02-09 17:08:28.249; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments"
      	at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1221)
      	at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1338)
      	at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
      	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
      	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
      	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166)
      	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:935)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1089)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:701)
      	at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.AbstractDefaultValueUpdateProcessorFactory$DefaultValueUpdateProcessor.processAdd(AbstractDefaultValueUpdateProcessorFactory.java:94)
      	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247)
      	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
      	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
      	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
      	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
      	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2027)
      	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
      	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      	at org.eclipse.jetty.server.Server.handle(Server.java:497)
      	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:313)
      	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
      	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:626)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:546)
      	at java.lang.Thread.run(Thread.java:745)
      
      INFO  - 2015-02-09 17:08:28.250; org.apache.solr.schema.ZkIndexSchemaReader; Finished refreshing schema in 365 ms
      INFO  - 2015-02-09 17:08:28.262; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
      INFO  - 2015-02-09 17:08:28.262; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard1_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard1_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard2_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard2_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
      INFO  - 2015-02-09 17:08:28.268; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3f1b8e55[gettingstarted_shard1_replica2] main
      INFO  - 2015-02-09 17:08:28.268; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@71fc4c98[gettingstarted_shard2_replica2] main
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.core.QuerySenderListener; QuerySenderListener sending requests to Searcher@3f1b8e55[gettingstarted_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.core.QuerySenderListener; QuerySenderListener sending requests to Searcher@71fc4c98[gettingstarted_shard2_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.core.QuerySenderListener; QuerySenderListener done.
      INFO  - 2015-02-09 17:08:28.270; org.apache.solr.core.QuerySenderListener; QuerySenderListener done.
      INFO  - 2015-02-09 17:08:28.271; org.apache.solr.core.SolrCore; [gettingstarted_shard1_replica2] Registered new searcher Searcher@3f1b8e55[gettingstarted_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.271; org.apache.solr.core.SolrCore; [gettingstarted_shard2_replica2] Registered new searcher Searcher@71fc4c98[gettingstarted_shard2_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.272; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard1_replica2] webapp=/solr path=/update params={update.distrib=FROMLEADER&update.chain=add-unknown-fields-to-the-schema&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://192.168.1.2:8983/solr/gettingstarted_shard2_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false} {commit=} 0 10
      INFO  - 2015-02-09 17:08:28.272; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard2_replica2] webapp=/solr path=/update params={update.distrib=FROMLEADER&update.chain=add-unknown-fields-to-the-schema&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://192.168.1.2:8983/solr/gettingstarted_shard2_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false} {commit=} 0 10
      INFO  - 2015-02-09 17:08:28.283; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard2_replica2] webapp=/solr path=/update params={commit=true} {commit=} 0 27
      
      1. SOLR-7091.patch
        11 kB
        Steve Rowe
      2. SOLR-7091.patch
        5 kB
        Steve Rowe
      3. SOLR-7091.patch
        4 kB
        Steve Rowe

        Activity

        Hide
        Steve Rowe added a comment -

        I see the same problem on standalone Solr - from solr/example/schemaless/logs/solr.log after launching the schemaless example (bin/solr -e schemaless and sending the nested docs update from the ref guide link in the issue description:

        INFO  - 2015-02-09 19:50:36.131; org.apache.solr.schema.ManagedIndexSchema; Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/branches/lucene_solr_5_0/solr/example/schemaless/solr/gettingstarted/conf/managed-schema
        INFO  - 2015-02-09 19:50:36.144; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted] webapp=/solr path=/update params={} {} 0 84
        ERROR - 2015-02-09 19:50:36.145; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments"
                at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1222)
                at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1339)
                at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110)
                at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:186)
                at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:161)
                at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:256)
                at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:411)
                at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1199)
                at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238)
                at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166)
                at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:931)
                at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1085)
                at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:697)
                at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
                at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                at org.apache.solr.update.processor.AbstractDefaultValueUpdateProcessorFactory$DefaultValueUpdateProcessor.processAdd(AbstractDefaultValueUpdateProcessorFactory.java:94)
                at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247)
                at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
                at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
                at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
                at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
                at org.apache.solr.core.SolrCore.execute(SolrCore.java:2006)
                at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
                at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413)
                at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204)
                at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
                at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
                at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
                at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
                at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
                at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
                at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
                at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
                at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
                at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
                at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
                at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
                at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
                at org.eclipse.jetty.server.Server.handle(Server.java:368)
                at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
                at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
                at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
                at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
                at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
                at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
                at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
                at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
                at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
                at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
                at java.lang.Thread.run(Thread.java:745)
        
        Show
        Steve Rowe added a comment - I see the same problem on standalone Solr - from solr/example/schemaless/logs/solr.log after launching the schemaless example ( bin/solr -e schemaless and sending the nested docs update from the ref guide link in the issue description: INFO - 2015-02-09 19:50:36.131; org.apache.solr.schema.ManagedIndexSchema; Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/branches/lucene_solr_5_0/solr/example/schemaless/solr/gettingstarted/conf/managed-schema INFO - 2015-02-09 19:50:36.144; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted] webapp=/solr path=/update params={} {} 0 84 ERROR - 2015-02-09 19:50:36.145; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments" at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1222) at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1339) at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110) at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:186) at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:161) at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:256) at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:411) at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1199) at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:931) at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1085) at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:697) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.AbstractDefaultValueUpdateProcessorFactory$DefaultValueUpdateProcessor.processAdd(AbstractDefaultValueUpdateProcessorFactory.java:94) at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247) at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2006) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745)
        Hide
        Steve Rowe added a comment -

        Simple test that reproduces the problem on standalone Solr, along with test schema and solrconfig changes necessary to support blockjoin: _root_ field in the schema and perSegCache in solrconfig (these didn't fix the problem).

        Show
        Steve Rowe added a comment - Simple test that reproduces the problem on standalone Solr, along with test schema and solrconfig changes necessary to support blockjoin: _root_ field in the schema and perSegCache in solrconfig (these didn't fix the problem).
        Hide
        Steve Rowe added a comment -

        The first patch only worked in IntelliJ, because it was modifying files in the test resources directory, and the Ant build disallows that.

        This version of the patch runs properly under Ant.

        Here's the log:

           [junit4]   2> 3800 T13 oas.SolrTestCaseJ4.initCore ####initCore end
           [junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@567f4255
           [junit4]   2> 4030 T13 C0 oass.ManagedIndexSchema.persistManagedSchema Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/trunk2/solr/build/solr-core/test/J0/temp/solr.update.DataDrivenBlockJoinTest 70603DAA880A6618-001/tempDir-001/collection1/conf/managed-schema
           [junit4]   2> 4097 T13 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {} 0 295
           [junit4]   2> 4099 T13 C0 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child'
           [junit4]   2> 		at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184)
           [junit4]   2> 		at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
           [junit4]   2> 		at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
           [junit4]   2> 		at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
           [junit4]   2> 		at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
           [junit4]   2> 		at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
           [junit4]   2> 		at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235)
           [junit4]   2> 		at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163)
           [junit4]   2> 		at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
           [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]   2> 		at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
           [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]   2> 		at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964)
           [junit4]   2> 		at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704)
           [junit4]   2> 		at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
           [junit4]   2> 		at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250)
           [junit4]   2> 		at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177)
           [junit4]   2> 		at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
           [junit4]   2> 		at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
           [junit4]   2> 		at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
           [junit4]   2> 		at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026)
           [junit4]   2> 		at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131)
           [junit4]   2> 		at org.apache.solr.util.TestHarness.update(TestHarness.java:278)
           [junit4]   2> 		at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
           [junit4]   2> 		at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
           [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702)
           [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681)
           [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675)
           [junit4]   2> 		at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55)
           [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
           [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
           [junit4]   2> 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
           [junit4]   2> 		at java.lang.reflect.Method.invoke(Method.java:483)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
           [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
           [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
           [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
           [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
           [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
           [junit4]   2> 	
           [junit4]   2> 4104 T13 oas.SolrTestCaseJ4.tearDown ###Ending test
           [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DataDrivenBlockJoinTest -Dtests.method=test -Dtests.seed=70603DAA880A6618 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=ECT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
           [junit4] ERROR   3.17s | DataDrivenBlockJoinTest.test <<<
           [junit4]    > Throwable #1: org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child'
           [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70603DAA880A6618:F834027026F60BE0]:0)
           [junit4]    > 	at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184)
           [junit4]    > 	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
           [junit4]    > 	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
           [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
           [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
           [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
           [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235)
           [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163)
           [junit4]    > 	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
           [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]    > 	at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
           [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
           [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
           [junit4]    > 	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964)
           [junit4]    > 	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704)
           [junit4]    > 	at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
           [junit4]    > 	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250)
           [junit4]    > 	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177)
           [junit4]    > 	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
           [junit4]    > 	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
           [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
           [junit4]    > 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026)
           [junit4]    > 	at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131)
           [junit4]    > 	at org.apache.solr.util.TestHarness.update(TestHarness.java:278)
           [junit4]    > 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
           [junit4]    > 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
           [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702)
           [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681)
           [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675)
           [junit4]    > 	at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55)
           [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
        
        Show
        Steve Rowe added a comment - The first patch only worked in IntelliJ, because it was modifying files in the test resources directory, and the Ant build disallows that. This version of the patch runs properly under Ant. Here's the log: [junit4] 2> 3800 T13 oas.SolrTestCaseJ4.initCore ####initCore end [junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@567f4255 [junit4] 2> 4030 T13 C0 oass.ManagedIndexSchema.persistManagedSchema Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/trunk2/solr/build/solr-core/test/J0/temp/solr.update.DataDrivenBlockJoinTest 70603DAA880A6618-001/tempDir-001/collection1/conf/managed-schema [junit4] 2> 4097 T13 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {} 0 295 [junit4] 2> 4099 T13 C0 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child' [junit4] 2> at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184) [junit4] 2> at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187) [junit4] 2> at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162) [junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257) [junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410) [junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194) [junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235) [junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163) [junit4] 2> at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964) [junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704) [junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) [junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250) [junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177) [junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103) [junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) [junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) [junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026) [junit4] 2> at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131) [junit4] 2> at org.apache.solr.util.TestHarness.update(TestHarness.java:278) [junit4] 2> at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282) [junit4] 2> at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252) [junit4] 2> at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702) [junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681) [junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675) [junit4] 2> at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 4104 T13 oas.SolrTestCaseJ4.tearDown ###Ending test [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DataDrivenBlockJoinTest -Dtests.method=test -Dtests.seed=70603DAA880A6618 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=ECT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] ERROR 3.17s | DataDrivenBlockJoinTest.test <<< [junit4] > Throwable #1: org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child' [junit4] > at __randomizedtesting.SeedInfo.seed([70603DAA880A6618:F834027026F60BE0]:0) [junit4] > at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184) [junit4] > at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187) [junit4] > at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194) [junit4] > at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235) [junit4] > at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163) [junit4] > at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964) [junit4] > at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704) [junit4] > at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) [junit4] > at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250) [junit4] > at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177) [junit4] > at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103) [junit4] > at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) [junit4] > at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) [junit4] > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026) [junit4] > at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131) [junit4] > at org.apache.solr.util.TestHarness.update(TestHarness.java:278) [junit4] > at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282) [junit4] > at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252) [junit4] > at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702) [junit4] > at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681) [junit4] > at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675) [junit4] > at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55) [junit4] > at java.lang.Thread.run(Thread.java:745)
        Hide
        Steve Rowe added a comment -

        Patch with a fix, including the test that failed without the patch (modified to include multiple nesting levels: parent/child/grandchild, as well as a same-named field with values that would be guessed differently at each level).

        The issue is that nested documents' fields are completely ignored by AddSchemaFieldsUpdateProcessorFactory. I had to change the field guessing strategy a little so that all parent + nested documents' same-named fields are examined at the same time when performing the field guessing.

        This patch also adds the "perSegFilter" cache (used by the block join parent qparser) to data_driven_schema_configs.

        All Solr core tests pass. Committing shortly, after precommit succeeds.

        Show
        Steve Rowe added a comment - Patch with a fix, including the test that failed without the patch (modified to include multiple nesting levels: parent/child/grandchild, as well as a same-named field with values that would be guessed differently at each level). The issue is that nested documents' fields are completely ignored by AddSchemaFieldsUpdateProcessorFactory . I had to change the field guessing strategy a little so that all parent + nested documents' same-named fields are examined at the same time when performing the field guessing. This patch also adds the " perSegFilter " cache (used by the block join parent qparser) to data_driven_schema_configs. All Solr core tests pass. Committing shortly, after precommit succeeds.
        Hide
        ASF subversion and git services added a comment -

        Commit 1685660 from Steve Rowe in branch 'dev/trunk'
        [ https://svn.apache.org/r1685660 ]

        SOLR-7091: Nested documents with unknown fields don't work in schemaless mode.

        Show
        ASF subversion and git services added a comment - Commit 1685660 from Steve Rowe in branch 'dev/trunk' [ https://svn.apache.org/r1685660 ] SOLR-7091 : Nested documents with unknown fields don't work in schemaless mode.
        Hide
        ASF subversion and git services added a comment -

        Commit 1685666 from Steve Rowe in branch 'dev/branches/branch_5x'
        [ https://svn.apache.org/r1685666 ]

        SOLR-7091: Nested documents with unknown fields don't work in schemaless mode. (merged trunk r1685660)

        Show
        ASF subversion and git services added a comment - Commit 1685666 from Steve Rowe in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1685666 ] SOLR-7091 : Nested documents with unknown fields don't work in schemaless mode. (merged trunk r1685660)
        Hide
        Steve Rowe added a comment -

        Committed to trunk and branch_5x.

        Thanks for reporting, Tim.

        Show
        Steve Rowe added a comment - Committed to trunk and branch_5x. Thanks for reporting, Tim.
        Hide
        Shalin Shekhar Mangar added a comment -

        Bulk close for 5.3.0 release

        Show
        Shalin Shekhar Mangar added a comment - Bulk close for 5.3.0 release

          People

          • Assignee:
            Steve Rowe
            Reporter:
            Timothy Potter
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development