[PARQUET-138] Parquet should allow a merge between required and optional schemas

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.11.0
• Component/s: parquet-mr
• Labels: pull-request-available
• Assignee: Nicolas Trinquier
• Reporter: Robert Justice
• Created: 21/Nov/14 19:15
• Updated: 22/Feb/19 11:05
• Resolved: 01/Feb/19 18:52

Description

In discussion with Ryan, he felt we should be able to merge from required binary to optional binary and the resulting schema would be optional

https://github.com/Parquet/parquet-mr/blob/master/parquet-column/src/test/java/parquet/schema/TestMessageType.java

try {
      t3.union(t4);
      fail("moving from optional to required");
    } catch (IncompatibleSchemaModificationException e) {
      assertEquals("repetition constraint is more restrictive: can not merge type required binary a into optional binary a", e.getMessage());
    }

Issue Links

• links to: GitHub Pull Request #550
• links to: GitHub Pull Request #623