[HUDI-543] Carefully draft release notes for 0.5.1 with all breaking/user impacting changes

• Type: Task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.5.1
• Component/s: Release & Administrative
• Labels: pull-request-available
• Assignee: leesf
• Reporter: Vinoth Chandar
• Created: 17/Jan/20 09:23
• Updated: 03/Feb/20 03:16
• Resolved: 31/Jan/20 07:36

Description

Call out all breaking changes : 

• Spark 2.4 support drop, avro version change etc.  "Hudi 0.5.1+ above needs Spark 2.4+"
• Need for shading custom Payloads 
• --packages for spark-shell 
• key generator changes 
• _ro suffix for read optimized views.. 
• Delta streamer command line changes
• Scala version changes.. packages names now have _2.11

 

Also need to call out major release highlights (quoting docs/blogs as available)

• better delete support
• dynamic bloom filters
• DMS support

 

 

I am also linking the different jiras as subtaks

Issue Links

• is a parent of: HUDI-536 Update release notes to include KeyGenerator package changes
• is a parent of: HUDI-519 Document the need for Avro dependency shading/relocation for custom payloads, need for spark-avro
• links to: GitHub Pull Request #1277

Sub-Tasks

• Call out changes in package names due to scala cross compiling support: Closed
• Update HowToRelease Page to release hudi with both versions of scala: Closed
• Add to Release Notes : Configuration Value change for Kafka Reset Offset Strategies: Closed