Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22874

Modify checking pandas version to use LooseVersion.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • PySpark, SQL
    • None

    Description

      Currently we check pandas version by capturing if ImportError for the specific imports is raised or not but we can compare LooseVersion of the version string as the same as we're checking pyarrow version.

      Attachments

        Activity

          People

            ueshin Takuya Ueshin
            ueshin Takuya Ueshin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: