[LUCENE-10471] Increase the number of dims for KNN vectors to 2048

• Type: Wish
• Status: Open
• Priority: Trivial
• Resolution: Unresolved
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Mayya Sharipova
• Created: 17/Mar/22 10:26
• Updated: 28/Aug/22 16:37

Description

The current maximum allowed number of dimensions is equal to 1024. But we see in practice a couple well-known models that produce vectors with > 1024 dimensions (e.g mobilenet_v2 uses 1280d vectors, OpenAI / GPT-3 Babbage uses 2048d vectors). Increasing max dims to `2048` will satisfy these use cases.

I am wondering if anybody has strong objections against this.

Issue Links

• links to: GitHub Pull Request #874