[SPARK-49820] change IOError to OSError

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: PySpark
• Labels: pull-request-available
• Assignee: Bjørn Jørgensen
• Reporter: Bjørn Jørgensen
• Created: 27/Sep/24 19:23
• Updated: 27/Sep/24 23:52
• Resolved: 27/Sep/24 23:52

Description

OSError is the builtin error type used for exceptions that relate to the operating system.

In Python 3.3, a variety of other exceptions, like WindowsError were aliased to OSError. These aliases remain in place for compatibility with older versions of Python, but may be removed in future versions.

Prefer using OSError directly, as it is more idiomatic and future-proof.

Example

raise IOError
Use instead:

raise OSError

https://docs.astral.sh/ruff/rules/os-error-alias/
https://docs.python.org/3/library/exceptions.html#OSError

Issue Links

• links to: GitHub Pull Request #48287