[ARROW-2843] [Format/C++/Java] Removing field layout from Schema.fbs breaks backward compatibility

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.8.0, 0.9.0
• Component/s: Format
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/19218
• Assignee: Yuliya Feldman
• Reporter: Yuliya Feldman
• Created: 12/Jul/18 22:57
• Updated: 11/Jan/23 07:23
• Resolved: 20/Jul/18 01:39

Description

Change in ARROW-1785

Breaks backward compatibility with schema generated in prior versions of Arrow, as VectorLayout field was removed from Field table.

This is definitely not supported behavior in FlatBuffers.

I suggest to put back following field

layout: [ VectorLayout ] (deprecated);

 into 

table Field 

and mark it "deprecated" - as shown above

It will also require putting back 

table VectorLayout

which can have all the deprecated fields as well.

code generation footprint will be minimal in this case, as FlatBuffers won't generate getters for deprecated fields, but it will really solve backward compatibility issues.

Also may be a good idea to introduce "version" into Schema.

 

 

 

Issue Links

• links to: GitHub Pull Request #2263