[HADOOP-14335] Improve DynamoDB schema update story

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.0.0-beta1
• Component/s: fs/s3
• Assignee: Sean Mackrory
• Reporter: Sean Mackrory
• Created: 20/Apr/17 22:22
• Updated: 27/Feb/21 10:58
• Resolved: 27/Feb/21 10:58

Description

On HADOOP-13760 I'm realizing that changes to the DynamoDB schema aren't great to deal with. Currently a build of Hadoop is hard-coded to a specific schema version. So if you upgrade from one to the next you have to upgrade everything (and then update the version in the table - which we don't have a tool or document for) before you can keep using S3Guard. We could possibly also make the definition of compatibility a bit more flexible, but it's going to be very tough to do that without knowing what kind of future schema changes we might want ahead of time.