[SPARK-3851] Support for reading parquet files with different but compatible schema

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: SQL
• Target Version/s: 1.3.0
• Assignee: Cheng Lian
• Reporter: Michael Armbrust
• Created: 08/Oct/14 20:08
• Updated: 25/Feb/15 00:11
• Resolved: 16/Feb/15 20:56

Description

Right now it is required that all of the parquet files have the same schema. It would be nice to support some safe subset of cases where the schemas of files is different. For example:

• Adding and removing nullable columns.
• Widening types (a column that is of both Int and Long type)