[HUDI-6739] Avoid checking timeline for successful commits for spark structured streaming when offset is 0

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Fix Version/s: 1.0.0-beta1
• Component/s: spark
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Aditya Goenka
• Created: 23/Aug/23 11:05
• Updated: 10/Oct/23 18:26
• Resolved: 10/Oct/23 18:26

Description

For Spark Structured Streaming writer, for new writer we are checking the active timeline to identify the last successful commit and fix idempotency. 

No need to check the checkpoint when the offset is 0 as that will mean it will be the new writer.

Issue Links

• links to: GitHub Pull Request #9510