[HUDI-2307] When using delete_partition with ds should not rely on the primary key

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Labels: pull-request-available
• Assignee: liujinhui
• Reporter: liujinhui
• Created: 13/Aug/21 08:43
• Updated: 15/Aug/21 02:50
• Resolved: 15/Aug/21 02:50

Description

 

Caused by: org.apache.hudi.exception.HoodieKeyException: recordKey value: "null" for field: "uuid" cannot be null or empty.Caused by: org.apache.hudi.exception.HoodieKeyException: recordKey value: "null" for field: "uuid" cannot be null or empty. at org.apache.hudi.keygen.KeyGenUtils.getRecordKey(KeyGenUtils.java:141) at org.apache.hudi.keygen.SimpleAvroKeyGenerator.getRecordKey(SimpleAvroKeyGenerator.java:50) at org.apache.hudi.keygen.SimpleKeyGenerator.getRecordKey(SimpleKeyGenerator.java:58) at org.apache.hudi.keygen.BaseKeyGenerator.getKey(BaseKeyGenerator.java:62) at org.apache.hudi.HoodieSparkSqlWriter$$anonfun$5.apply(HoodieSparkSqlWriter.scala:195) at org.apache.hudi.HoodieSparkSqlWriter$$anonfun$5.apply(HoodieSparkSqlWriter.scala:195) at scala.collection.Iterator$$anon$11.next(Iterator.scala:410) at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)

 

When using delete_partition, we should not rely on the primary key

 

aa 

Issue Links

• links to: GitHub Pull Request #3469