[SPARK-23300] Print out if Pandas and PyArrow are installed or not in tests

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: PySpark, Tests
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 01/Feb/18 12:53
• Updated: 12/Dec/22 18:10
• Resolved: 06/Feb/18 07:09

Description

This is related with SPARK-23292. Some tests with, for example, PyArrow and Pandas are currently not running in some Python versions in Jenkins.

At least, we should print out if we are skipping the tests or now explicitly in the console.

Issue Links

• is related to: SPARK-24044 Explicitly print out skipped tests from unittest module
• relates to: SPARK-23292 python tests related to pandas are skipped with python 2
• links to: [Github] Pull Request #20473 (HyukjinKwon)
• links to: [Github] Pull Request #20533 (HyukjinKwon)