[SOLR-17050] Store the models compacted so we can store bigger models on zk

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: main (10.0), 9.4
• Fix Version/s: 9.5
• Component/s: contrib - LTR, ltr
• Assignee: Christine Poerschke
• Reporter: Florin Babes
• Created: 21/Oct/23 07:18
• Updated: 12/Feb/24 19:49
• Resolved: 04/Dec/23 14:30

Description

We reached the limit of zk for storing LTR models. I want to avoid the
usage of DefaultWrapperModel for as long as possible because we have
deployed in an container orchestrator and this implementation can be
really risky if you can not guarantee the presence of the model on
disk all the time.
So I want to use the managed model feature to upload some bigger
models but zk is dying with OOM. What we noticed is that solr stores
the models in a json indented file. By saving the models in compacted
json our models will be 60% smaller.

user mailing list thread: https://lists.apache.org/thread/5s5dq4j4bd74sfym7frwoqdokoh64s5l

Issue Links

• links to: GitHub Pull Request #2030