[SOLR-11049] Solr in cloud mode silently fails uploading a big LTR model

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Workaround
• Fix Version/s: 7.2, 8.0
• Component/s: contrib - LTR

Environment

tested with Solr 6.6 an integrated zookeeper

• Assignee: Unassigned
• Reporter: Stefan Langenmaier
• Created: 12/Jul/17 08:10
• Updated: 02/Oct/19 17:24
• Resolved: 01/Dec/17 15:52

Description

Hi,

I'm using Solr in cloud mode, I have a MultipleAdditiveTreesModel with about 3MB in size. When I upload the model with

curl -v -XPUT 'http://localhost:8983/solr/tmdb/schema/model-store' --data-binary @/big-tree.model -H 'Content-type:application/json'

I get the following response

{
  "responseHeader":{
    "status":0,
    "QTime":24318}
}

This looks kind of slow but without an error. When I check the config the model is not visible and when I try to run a query that uses the model I get the following error

"error":{
    "metadata":[
      "error-class","org.apache.solr.common.SolrException",
      "root-error-class","org.apache.solr.common.SolrException"],
    "msg":"cannot find model bigTreeModel",
    "code":400}

When I upload the model to solr where I increased the zookeeper znode size limit with

-Djute.maxbuffer=0x1ffffff

the same model upload succeeds much faster

{
  "responseHeader":{
    "status":0,
    "QTime":689}
}

The model is visible in the configuration and queries that use it run without error.

Issue Links

• is related to: SOLR-4793 Solr Cloud can't upload large config files ( > 1MB) to Zookeeper
• relates to: SOLR-11250 Add new LTR model which loads the model definition from the external resource
• relates to: SOLR-12590 Improve Solr resource loader coverage in the ref guide