Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22874

Modify checking pandas version to use LooseVersion.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.3.0
    • Component/s: PySpark, SQL
    • Labels:
      None

      Description

      Currently we check pandas version by capturing if ImportError for the specific imports is raised or not but we can compare LooseVersion of the version string as the same as we're checking pyarrow version.

        Attachments

          Activity

            People

            • Assignee:
              ueshin Takuya Ueshin
              Reporter:
              ueshin Takuya Ueshin
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: