[SPARK-50024] Some warn messages should actually use logger instead of the warnings module

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect, PySpark
• Labels: pull-request-available
• Assignee: Niranjan Jayakar
• Reporter: Niranjan Jayakar
• Created: 18/Oct/24 07:13
• Updated: 20/Oct/24 01:14
• Resolved: 20/Oct/24 01:14

Description

Some warnings messages in the Pyspark connect module are meant more as informational. They are now using the 'warnings' module which incorrectly pops up not in the log output but rather stdout.

The warnings module should be used only to produce user facing warnings because of an action they have taken.

Issue Links

• links to: GitHub Pull Request #48519