[LUCY-300] Restrict max field length to 2 GB

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Assignee: Marvin Humphrey
• Reporter: Marvin Humphrey
• Created: 21/Apr/16 02:14
• Updated: 22/Apr/16 01:15
• Resolved: 22/Apr/16 01:15

Description

Install an early sanity check restricting field lengths to a maximum of 2 GB.

Prior to 0.5.0, the maximum was no greater than 4 GB, because String had size measured in uint32_t. The practical size is generally much smaller anyway because 1) the original string plus all its tokens takes up a lot of space, and 2) Lucy is not ideal for huge documents.