Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-229

Spark version check fails when it's used with HDP built Spark

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.3
    • 0.3
    • Server
    • None

    Description

      Spark version check fails when it's used with HDP built Spark.

      Exception in thread "main" java.lang.IllegalArgumentException: Fail to parse Spark version from 2.0.0.2.5.1.0-56.
      

      As 2.0.0.2.5.1.0-56 doesn't match regex

        def formatSparkVersion(version: String): (Int, Int) = {
          val versionPattern = """(\d)+\.(\d)+(?:\.\d*)?""".r
      

      Attachments

        Activity

          People

            tc0312 Alex Man
            tc0312 Alex Man
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: