[SPARK-50407] accessing a MySQL database through a proxy that has a set timeout, an error occurs when using df.write.jdbc

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Connect
• Assignee: Unassigned
• Reporter: chenzichu
• Created: 1 week ago 08:32
• Updated: 6 days ago 01:20

Description

When accessing a MySQL database through a proxy that has a set timeout, an error occurs when using df.write.mode(SaveMode.Append).jdbc(url, table, properties).

error msg :
 

The reason for this error is that the JdbcRelationProvider created a connection on the driver side, but did not close it after use; instead, it was closed after the saveTable method was called. At this point, Nginx detected that there was no data transfer on the connection and directly closed the connection, leading to an error when calling conn.close(): "no more data to read from socket".