Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Value vectors currently have a single type for all of the values they contain. This enforces that the schema within a single record batch be constant, thus we cannot support changing the type of a column without starting a new batch. In cases where the schema changes frequently this does not provide enough flexibility for storing and processing records. For this case we will eventually be extending out Value Vector model with a new Embedded Type vector, which will have type information associated with individual values within a batch rather than applied to all values.