[IGNITE-14556] Live Schema. Add Tuple validation.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Do
• Labels: iep-54 ignite-3
• Ignite Flags: Docs Required, Release Notes Required
• Assignee: Unassigned
• Reporter: Andrey Mashenkov
• Created: 15/Apr/21 14:44
• Updated: 15/Nov/21 10:44
• Resolved: 15/Nov/21 10:44

Description

Motivation.

At a point of Table public method is called by a user, we need to validate user input (for LIVE-schema purposes at least).

Description.

We can add this logic to check if value fields match the current schema version (no new fields).

• For LIVE-Schema. If Tuple has one or more additional columns, then we should try to register a new schema first, then proceed with the user operation.
• For STRICT-Schema.  If Tuple has one or more additional columns, then we should fail the user operation.
• For KeyValueView, we should validate key Tuple as well, and fail if there are unknown columns. Because a key column span is immutable. The only exception may be if a user creates a schemaless table, then a schema of the 1-st version should be registered instantly.

Assumed, any column type mismatch or missed Non-Nullable columns will be caught and processed by RowAssembler.

Possible optimization.

It is possible to add the validation into a TupleBuilder and then just check the Tuple instance class (should be a builder).
For any Tuple of unknown type or if a schema was changed concurrently (TupleBuilder validated input against outdated schema version), then fallback to default logic and re-validate input against the latest schema.

 

Issue Links

• incorporates: IGNITE-14692 Validate tuple for STRICT schema
• is a child of: IGNITE-13616 IEP-54 Live schema for tables