[PHOENIX-5631] Phoenix-Spark PhoenixDataWriter#write should not commit mutations

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: connectors-6.0.0
• Fix Version/s: connectors-6.0.0
• Labels: phoenix-spark
• Assignee: Unassigned
• Reporter: Chinmay Kulkarni
• Created: 17/Dec/19 05:59
• Updated: 09/Jan/20 01:56

Description

For the Phoenix-Spark PhoenixDataWriter, we should not commit inside the write method since this breaks the contract mentioned in DataSourceV2 DataWriter as DataWriter#commit should be the one that commits this writer after all records are written successfully via DataWriter#write.

We may need to revert or modify the changes done to upsert mutations in batches done in PHOENIX-5232.