Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-7091

Data-driven schema and block-join style update requests don't play well together

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 5.3, 6.0
    • None
    • None

    Description

      Tried to index the basic block-join example docs from the refguide (see link below) into the gettingstarted collection, which uses the data-driven schema configs:
      https://cwiki.apache.org/confluence/display/solr/Other+Parsers#OtherParsers-BlockJoinQueryParsers

      Here's the result:

      $ bin/post -c gettingstarted block-join/docs.xml 
      java -classpath dist/solr-core-6.0.0-SNAPSHOT.jar -Dauto=yes -Dc=gettingstarted -Ddata=files org.apache.solr.util.SimplePostTool block-join/docs.xml
      SimplePostTool version 5.0.0
      Posting files to [base] url http://localhost:8983/solr/gettingstarted/update...
      Entering auto mode. File endings considered are xml,json,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log
      POSTing file docs.xml (application/xml) to [base]
      SimplePostTool: WARNING: Solr returned an error #400 (Bad Request) for url: http://localhost:8983/solr/gettingstarted/update
      SimplePostTool: WARNING: Response: <?xml version="1.0" encoding="UTF-8"?>
      <response>
      <lst name="responseHeader"><int name="status">400</int><int name="QTime">429</int></lst><lst name="error"><str name="msg">undefined field: "comments"</str><int name="code">400</int></lst>
      </response>
      SimplePostTool: WARNING: IOException while reading response: java.io.IOException: Server returned HTTP response code: 400 for URL: http://localhost:8983/solr/gettingstarted/update
      1 files indexed.
      COMMITting Solr index changes to http://localhost:8983/solr/gettingstarted/update...
      Time spent: 0:00:00.481
      

      Logs from the leader are:

      INFO  - 2015-02-09 17:08:27.882; org.apache.solr.schema.ManagedIndexSchema; Persisted managed schema version 1 at /configs/gettingstarted/managed-schema
      ERROR - 2015-02-09 17:08:27.882; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:27.883; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      INFO  - 2015-02-09 17:08:27.882; org.apache.solr.schema.ZkIndexSchemaReader$1; A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/gettingstarted/managed-schema, has occurred - updating schema from ZooKeeper ...
      INFO  - 2015-02-09 17:08:27.882; org.apache.solr.schema.ZkIndexSchemaReader$1; A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/gettingstarted/managed-schema, has occurred - updating schema from ZooKeeper ...
      INFO  - 2015-02-09 17:08:27.884; org.apache.solr.schema.ZkIndexSchemaReader; Retrieved schema version 1 from ZooKeeper
      ERROR - 2015-02-09 17:08:27.891; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:27.892; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      ERROR - 2015-02-09 17:08:27.896; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:27.896; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      INFO  - 2015-02-09 17:08:27.896; org.apache.solr.schema.ZkIndexSchemaReader; Retrieved schema version 1 from ZooKeeper
      INFO  - 2015-02-09 17:08:27.947; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard1_replica2] webapp=/solr path=/update params={update.distrib=TOLEADER&update.chain=add-unknown-fields-to-the-schema&distrib.from=http://192.168.1.2:8983/solr/gettingstarted_shard2_replica2/&wt=javabin&version=2} {} 0 90
      ERROR - 2015-02-09 17:08:27.949; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments"
      	at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1221)
      	at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1338)
      	at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
      	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
      	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
      	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166)
      	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:935)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1089)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:701)
      	at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
      	at org.apache.solr.handler.loader.JavabinLoader$1.update(JavabinLoader.java:96)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:166)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readIterator(JavaBinUpdateRequestCodec.java:136)
      	at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:225)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$1.readNamedList(JavaBinUpdateRequestCodec.java:121)
      	at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:190)
      	at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:116)
      	at org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:173)
      	at org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:106)
      	at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:58)
      	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
      	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
      	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
      	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2027)
      	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
      	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      	at org.eclipse.jetty.server.Server.handle(Server.java:497)
      	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:313)
      	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
      	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:626)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:546)
      	at java.lang.Thread.run(Thread.java:745)
      
      ERROR - 2015-02-09 17:08:27.952; org.apache.solr.update.StreamingSolrClients$1; error
      org.apache.solr.common.SolrException: Bad Request
      
      
      
      request: http://192.168.1.2:8983/solr/gettingstarted_shard1_replica2/update?update.chain=add-unknown-fields-to-the-schema&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F192.168.1.2%3A8983%2Fsolr%2Fgettingstarted_shard2_replica2%2F&wt=javabin&version=2
      	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:242)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      INFO  - 2015-02-09 17:08:28.242; org.apache.solr.schema.ZkIndexSchemaReader; Finished refreshing schema in 345 ms
      ERROR - 2015-02-09 17:08:28.247; org.apache.solr.schema.ManagedIndexSchema; Bad version when trying to persist schema using 0 due to: org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /configs/gettingstarted/managed-schema
      INFO  - 2015-02-09 17:08:28.247; org.apache.solr.schema.ManagedIndexSchema; Failed to persist managed schema at /configs/gettingstarted/managed-schema - version mismatch
      INFO  - 2015-02-09 17:08:28.249; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard2_replica2] webapp=/solr path=/update params={} {add=[1]} 0 429
      ERROR - 2015-02-09 17:08:28.249; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments"
      	at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1221)
      	at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1338)
      	at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
      	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
      	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
      	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
      	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238)
      	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166)
      	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:935)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1089)
      	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:701)
      	at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
      	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
      	at org.apache.solr.update.processor.AbstractDefaultValueUpdateProcessorFactory$DefaultValueUpdateProcessor.processAdd(AbstractDefaultValueUpdateProcessorFactory.java:94)
      	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247)
      	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
      	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
      	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
      	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
      	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2027)
      	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
      	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      	at org.eclipse.jetty.server.Server.handle(Server.java:497)
      	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:313)
      	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
      	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:626)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:546)
      	at java.lang.Thread.run(Thread.java:745)
      
      INFO  - 2015-02-09 17:08:28.250; org.apache.solr.schema.ZkIndexSchemaReader; Finished refreshing schema in 365 ms
      INFO  - 2015-02-09 17:08:28.262; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
      INFO  - 2015-02-09 17:08:28.262; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard1_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard1_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard2_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
      	commit{dir=NRTCachingDirectory(MMapDirectory@/Users/timpotter/dev/lw/projects/solr_trunk_co/solr/example/cloud/node1/solr/gettingstarted_shard2_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ce628e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
      INFO  - 2015-02-09 17:08:28.265; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
      INFO  - 2015-02-09 17:08:28.268; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3f1b8e55[gettingstarted_shard1_replica2] main
      INFO  - 2015-02-09 17:08:28.268; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@71fc4c98[gettingstarted_shard2_replica2] main
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.core.QuerySenderListener; QuerySenderListener sending requests to Searcher@3f1b8e55[gettingstarted_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.core.QuerySenderListener; QuerySenderListener sending requests to Searcher@71fc4c98[gettingstarted_shard2_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.269; org.apache.solr.core.QuerySenderListener; QuerySenderListener done.
      INFO  - 2015-02-09 17:08:28.270; org.apache.solr.core.QuerySenderListener; QuerySenderListener done.
      INFO  - 2015-02-09 17:08:28.271; org.apache.solr.core.SolrCore; [gettingstarted_shard1_replica2] Registered new searcher Searcher@3f1b8e55[gettingstarted_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.271; org.apache.solr.core.SolrCore; [gettingstarted_shard2_replica2] Registered new searcher Searcher@71fc4c98[gettingstarted_shard2_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
      INFO  - 2015-02-09 17:08:28.272; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard1_replica2] webapp=/solr path=/update params={update.distrib=FROMLEADER&update.chain=add-unknown-fields-to-the-schema&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://192.168.1.2:8983/solr/gettingstarted_shard2_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false} {commit=} 0 10
      INFO  - 2015-02-09 17:08:28.272; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard2_replica2] webapp=/solr path=/update params={update.distrib=FROMLEADER&update.chain=add-unknown-fields-to-the-schema&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://192.168.1.2:8983/solr/gettingstarted_shard2_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false} {commit=} 0 10
      INFO  - 2015-02-09 17:08:28.283; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted_shard2_replica2] webapp=/solr path=/update params={commit=true} {commit=} 0 27
      

      Attachments

        1. SOLR-7091.patch
          11 kB
          Steven Rowe
        2. SOLR-7091.patch
          5 kB
          Steven Rowe
        3. SOLR-7091.patch
          4 kB
          Steven Rowe

        Activity

          sarowe Steven Rowe added a comment -

          I see the same problem on standalone Solr - from solr/example/schemaless/logs/solr.log after launching the schemaless example (bin/solr -e schemaless and sending the nested docs update from the ref guide link in the issue description:

          INFO  - 2015-02-09 19:50:36.131; org.apache.solr.schema.ManagedIndexSchema; Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/branches/lucene_solr_5_0/solr/example/schemaless/solr/gettingstarted/conf/managed-schema
          INFO  - 2015-02-09 19:50:36.144; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted] webapp=/solr path=/update params={} {} 0 84
          ERROR - 2015-02-09 19:50:36.145; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments"
                  at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1222)
                  at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1339)
                  at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110)
                  at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:186)
                  at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:161)
                  at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:256)
                  at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:411)
                  at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1199)
                  at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238)
                  at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166)
                  at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:931)
                  at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1085)
                  at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:697)
                  at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
                  at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
                  at org.apache.solr.update.processor.AbstractDefaultValueUpdateProcessorFactory$DefaultValueUpdateProcessor.processAdd(AbstractDefaultValueUpdateProcessorFactory.java:94)
                  at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247)
                  at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174)
                  at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
                  at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
                  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
                  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2006)
                  at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
                  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413)
                  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204)
                  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
                  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
                  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
                  at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
                  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
                  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
                  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
                  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
                  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
                  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
                  at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
                  at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
                  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
                  at org.eclipse.jetty.server.Server.handle(Server.java:368)
                  at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
                  at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
                  at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
                  at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
                  at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
                  at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
                  at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
                  at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
                  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
                  at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
                  at java.lang.Thread.run(Thread.java:745)
          
          sarowe Steven Rowe added a comment - I see the same problem on standalone Solr - from solr/example/schemaless/logs/solr.log after launching the schemaless example ( bin/solr -e schemaless and sending the nested docs update from the ref guide link in the issue description: INFO - 2015-02-09 19:50:36.131; org.apache.solr.schema.ManagedIndexSchema; Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/branches/lucene_solr_5_0/solr/example/schemaless/solr/gettingstarted/conf/managed-schema INFO - 2015-02-09 19:50:36.144; org.apache.solr.update.processor.LogUpdateProcessor; [gettingstarted] webapp=/solr path=/update params={} {} 0 84 ERROR - 2015-02-09 19:50:36.145; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException: undefined field: "comments" at org.apache.solr.schema.IndexSchema.getField(IndexSchema.java:1222) at org.apache.solr.schema.IndexSchema.getCopyFieldsList(IndexSchema.java:1339) at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:110) at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:186) at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:161) at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:256) at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:411) at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1199) at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:166) at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldNameMutatingUpdateProcessorFactory$1.processAdd(FieldNameMutatingUpdateProcessorFactory.java:79) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:931) at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1085) at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:697) at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) at org.apache.solr.update.processor.AbstractDefaultValueUpdateProcessorFactory$DefaultValueUpdateProcessor.processAdd(AbstractDefaultValueUpdateProcessorFactory.java:94) at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247) at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2006) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:413) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745)
          sarowe Steven Rowe added a comment -

          Simple test that reproduces the problem on standalone Solr, along with test schema and solrconfig changes necessary to support blockjoin: _root_ field in the schema and perSegCache in solrconfig (these didn't fix the problem).

          sarowe Steven Rowe added a comment - Simple test that reproduces the problem on standalone Solr, along with test schema and solrconfig changes necessary to support blockjoin: _root_ field in the schema and perSegCache in solrconfig (these didn't fix the problem).
          sarowe Steven Rowe added a comment -

          The first patch only worked in IntelliJ, because it was modifying files in the test resources directory, and the Ant build disallows that.

          This version of the patch runs properly under Ant.

          Here's the log:

             [junit4]   2> 3800 T13 oas.SolrTestCaseJ4.initCore ####initCore end
             [junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@567f4255
             [junit4]   2> 4030 T13 C0 oass.ManagedIndexSchema.persistManagedSchema Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/trunk2/solr/build/solr-core/test/J0/temp/solr.update.DataDrivenBlockJoinTest 70603DAA880A6618-001/tempDir-001/collection1/conf/managed-schema
             [junit4]   2> 4097 T13 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {} 0 295
             [junit4]   2> 4099 T13 C0 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child'
             [junit4]   2> 		at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184)
             [junit4]   2> 		at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
             [junit4]   2> 		at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
             [junit4]   2> 		at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
             [junit4]   2> 		at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
             [junit4]   2> 		at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
             [junit4]   2> 		at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235)
             [junit4]   2> 		at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163)
             [junit4]   2> 		at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
             [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]   2> 		at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
             [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]   2> 		at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]   2> 		at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964)
             [junit4]   2> 		at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704)
             [junit4]   2> 		at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
             [junit4]   2> 		at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250)
             [junit4]   2> 		at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177)
             [junit4]   2> 		at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
             [junit4]   2> 		at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
             [junit4]   2> 		at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
             [junit4]   2> 		at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026)
             [junit4]   2> 		at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131)
             [junit4]   2> 		at org.apache.solr.util.TestHarness.update(TestHarness.java:278)
             [junit4]   2> 		at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
             [junit4]   2> 		at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
             [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702)
             [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681)
             [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675)
             [junit4]   2> 		at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55)
             [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
             [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
             [junit4]   2> 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
             [junit4]   2> 		at java.lang.reflect.Method.invoke(Method.java:483)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
             [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
             [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
             [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
             [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
             [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
             [junit4]   2> 	
             [junit4]   2> 4104 T13 oas.SolrTestCaseJ4.tearDown ###Ending test
             [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DataDrivenBlockJoinTest -Dtests.method=test -Dtests.seed=70603DAA880A6618 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=ECT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
             [junit4] ERROR   3.17s | DataDrivenBlockJoinTest.test <<<
             [junit4]    > Throwable #1: org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child'
             [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70603DAA880A6618:F834027026F60BE0]:0)
             [junit4]    > 	at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184)
             [junit4]    > 	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187)
             [junit4]    > 	at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162)
             [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257)
             [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410)
             [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194)
             [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235)
             [junit4]    > 	at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163)
             [junit4]    > 	at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
             [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]    > 	at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328)
             [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]    > 	at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117)
             [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
             [junit4]    > 	at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964)
             [junit4]    > 	at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704)
             [junit4]    > 	at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
             [junit4]    > 	at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250)
             [junit4]    > 	at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177)
             [junit4]    > 	at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103)
             [junit4]    > 	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
             [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
             [junit4]    > 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026)
             [junit4]    > 	at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131)
             [junit4]    > 	at org.apache.solr.util.TestHarness.update(TestHarness.java:278)
             [junit4]    > 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
             [junit4]    > 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
             [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702)
             [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681)
             [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675)
             [junit4]    > 	at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55)
             [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
          
          sarowe Steven Rowe added a comment - The first patch only worked in IntelliJ, because it was modifying files in the test resources directory, and the Ant build disallows that. This version of the patch runs properly under Ant. Here's the log: [junit4] 2> 3800 T13 oas.SolrTestCaseJ4.initCore ####initCore end [junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@567f4255 [junit4] 2> 4030 T13 C0 oass.ManagedIndexSchema.persistManagedSchema Upgraded to managed schema at /Users/sarowe/svn/lucene/dev/trunk2/solr/build/solr-core/test/J0/temp/solr.update.DataDrivenBlockJoinTest 70603DAA880A6618-001/tempDir-001/collection1/conf/managed-schema [junit4] 2> 4097 T13 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {} 0 295 [junit4] 2> 4099 T13 C0 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child' [junit4] 2> at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184) [junit4] 2> at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187) [junit4] 2> at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162) [junit4] 2> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257) [junit4] 2> at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410) [junit4] 2> at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194) [junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235) [junit4] 2> at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163) [junit4] 2> at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] 2> at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964) [junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704) [junit4] 2> at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) [junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250) [junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177) [junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103) [junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) [junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) [junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026) [junit4] 2> at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131) [junit4] 2> at org.apache.solr.util.TestHarness.update(TestHarness.java:278) [junit4] 2> at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282) [junit4] 2> at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252) [junit4] 2> at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702) [junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681) [junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675) [junit4] 2> at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 4104 T13 oas.SolrTestCaseJ4.tearDown ###Ending test [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DataDrivenBlockJoinTest -Dtests.method=test -Dtests.seed=70603DAA880A6618 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=ECT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 [junit4] ERROR 3.17s | DataDrivenBlockJoinTest.test <<< [junit4] > Throwable #1: org.apache.solr.common.SolrException: ERROR: [doc=2] unknown field 'child' [junit4] > at __randomizedtesting.SeedInfo.seed([70603DAA880A6618:F834027026F60BE0]:0) [junit4] > at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:184) [junit4] > at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:187) [junit4] > at org.apache.solr.update.AddUpdateCommand$1.next(AddUpdateCommand.java:162) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:257) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:410) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1194) [junit4] > at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:235) [junit4] > at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:163) [junit4] > at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.AddSchemaFieldsUpdateProcessorFactory$AddSchemaFieldsUpdateProcessor.processAdd(AddSchemaFieldsUpdateProcessorFactory.java:328) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.FieldMutatingUpdateProcessor.processAdd(FieldMutatingUpdateProcessor.java:117) [junit4] > at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) [junit4] > at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:964) [junit4] > at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:704) [junit4] > at org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) [junit4] > at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250) [junit4] > at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177) [junit4] > at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:103) [junit4] > at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) [junit4] > at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144) [junit4] > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2026) [junit4] > at org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131) [junit4] > at org.apache.solr.util.TestHarness.update(TestHarness.java:278) [junit4] > at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282) [junit4] > at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252) [junit4] > at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:702) [junit4] > at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:681) [junit4] > at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:675) [junit4] > at org.apache.solr.update.DataDrivenBlockJoinTest.test(DataDrivenBlockJoinTest.java:55) [junit4] > at java.lang.Thread.run(Thread.java:745)
          sarowe Steven Rowe added a comment -

          Patch with a fix, including the test that failed without the patch (modified to include multiple nesting levels: parent/child/grandchild, as well as a same-named field with values that would be guessed differently at each level).

          The issue is that nested documents' fields are completely ignored by AddSchemaFieldsUpdateProcessorFactory. I had to change the field guessing strategy a little so that all parent + nested documents' same-named fields are examined at the same time when performing the field guessing.

          This patch also adds the "perSegFilter" cache (used by the block join parent qparser) to data_driven_schema_configs.

          All Solr core tests pass. Committing shortly, after precommit succeeds.

          sarowe Steven Rowe added a comment - Patch with a fix, including the test that failed without the patch (modified to include multiple nesting levels: parent/child/grandchild, as well as a same-named field with values that would be guessed differently at each level). The issue is that nested documents' fields are completely ignored by AddSchemaFieldsUpdateProcessorFactory . I had to change the field guessing strategy a little so that all parent + nested documents' same-named fields are examined at the same time when performing the field guessing. This patch also adds the " perSegFilter " cache (used by the block join parent qparser) to data_driven_schema_configs. All Solr core tests pass. Committing shortly, after precommit succeeds.

          Commit 1685660 from steve_rowe in branch 'dev/trunk'
          [ https://svn.apache.org/r1685660 ]

          SOLR-7091: Nested documents with unknown fields don't work in schemaless mode.

          jira-bot ASF subversion and git services added a comment - Commit 1685660 from steve_rowe in branch 'dev/trunk' [ https://svn.apache.org/r1685660 ] SOLR-7091 : Nested documents with unknown fields don't work in schemaless mode.

          Commit 1685666 from steve_rowe in branch 'dev/branches/branch_5x'
          [ https://svn.apache.org/r1685666 ]

          SOLR-7091: Nested documents with unknown fields don't work in schemaless mode. (merged trunk r1685660)

          jira-bot ASF subversion and git services added a comment - Commit 1685666 from steve_rowe in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1685666 ] SOLR-7091 : Nested documents with unknown fields don't work in schemaless mode. (merged trunk r1685660)
          sarowe Steven Rowe added a comment -

          Committed to trunk and branch_5x.

          Thanks for reporting, Tim.

          sarowe Steven Rowe added a comment - Committed to trunk and branch_5x. Thanks for reporting, Tim.

          Bulk close for 5.3.0 release

          shalin Shalin Shekhar Mangar added a comment - Bulk close for 5.3.0 release

          People

            sarowe Steven Rowe
            thelabdude Timothy Potter
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: