[HUDI-7154] Hudi Streamer with row writer enabled hits NPE with empty batch

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.14.1
• Labels: pull-request-available
• Assignee: sivabalan narayanan
• Reporter: Ethan Guo (this is the old account; please use "yihua")
• Created: 28/Nov/23 17:37
• Updated: 04/Dec/23 16:13
• Resolved: 04/Dec/23 16:13

Description

Hudi Streamer with row writer enabled hits NPE with empty batch (the checkpoint has advanced)

java.lang.NullPointerException
	at org.apache.hudi.HoodieSparkSqlWriter$.getBulkInsertRowConfig(HoodieSparkSqlWriter.scala:1190)
	at org.apache.hudi.HoodieSparkSqlWriter.getBulkInsertRowConfig(HoodieSparkSqlWriter.scala)
	at org.apache.hudi.utilities.streamer.StreamSync.prepareHoodieConfigForRowWriter(StreamSync.java:801)
	at org.apache.hudi.utilities.streamer.StreamSync.writeToSink(StreamSync.java:939)
	at org.apache.hudi.utilities.streamer.StreamSync.writeToSinkAndDoMetaSync(StreamSync.java:819)
	at org.apache.hudi.utilities.streamer.StreamSync.syncOnce(StreamSync.java:458)
	at org.apache.hudi.utilities.streamer.HoodieStreamer$StreamSyncService.ingestOnce(HoodieStreamer.java:850)
	at org.apache.hudi.common.util.Option.ifPresent(Option.java:97) 

Issue Links

• links to: GitHub Pull Request #10198