[PHOENIX-6657] Port Phoenix-Spark connector tests to the current API

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: connectors, spark-connector
• Labels: test
• Assignee: Istvan Toth
• Reporter: Istvan Toth
• Created: 28/Feb/22 09:19
• Updated: 14/Apr/23 06:56
• Resolved: 14/Apr/23 06:56

Description

There are a lot of tests for the old RDD / DataFrame API that have no equivalent for the new DataSource API.

This becomes apparent, as a number of the scala tests (PhoenixSparkIT.scala, etc) are failing with Spark3, but the java test suite does not find those problems.

Port the Scala tests for the old API to the new API, and preferably to the Java language.

Issue Links

• is related to: PHOENIX-6632 Migrate connectors to Spark-3