Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
None
Description
High priority issues with schema evolution for the ORC file format.
Schema evolution here is limited to adding new columns and a few cases of column type-widening (e.g. int to bigint).
Renaming columns, deleting column, moving columns and other schema evolution were not pursued due to lack of importance and lack of time. Also, it appears a much more sophisticated metadata would be needed to support them.
The biggest issues for users have been adding new columns for ACID table (HIVE-11421 Support Schema evolution for ACID tables) and vectorization (HIVE-10598 Vectorization borks when column is added to table).
Attachments
Attachments
Issue Links
- blocks
-
HIVE-11421 Support Schema evolution for ACID tables
- Resolved
- is related to
-
HIVE-12625 Backport to branch-1 HIVE-11981 ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)
- Resolved
-
SPARK-24472 Orc RecordReaderFactory throws IndexOutOfBoundsException
- Resolved
-
HIVE-12728 Apply DDL restrictions for ORC schema evolution
- Closed
-
HIVE-12799 Always use Schema Evolution for ACID
- Closed
- links to