[SOLR-8495] Schemaless mode cannot index large text fields

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 4.10.4, 5.3.1, 5.4
• Fix Version/s: 5.5, 6.0
• Component/s: Data-driven Schema, Schema and Analysis
• Labels: difficulty-easy impact-medium
• Assignee: Unassigned
• Reporter: Shalin Shekhar Mangar
• Created: 06/Jan/16 15:50
• Updated: 05/Jul/17 22:59
• Resolved: 05/Jul/17 22:59

Description

The schemaless mode by default indexes all string fields into an indexed StrField which is limited to 32KB text. Anything larger than that leads to an exception during analysis.

Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="text" (whose UTF8 encoding is longer than the max length 32766)

Issue Links

• duplicates: SOLR-9526 data_driven configs defaults to "strings" for unmapped fields, makes most fields containing "textual content" unsearchable, breaks tutorial examples
• is related to: SOLR-6966 For Data Driven Schema, consider multi-word text fields to be text, not string field types
• relates to: SOLR-9526 data_driven configs defaults to "strings" for unmapped fields, makes most fields containing "textual content" unsearchable, breaks tutorial examples