[SPARK-4900] MLlib SingularValueDecomposition ARPACK IllegalStateException

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.1.1, 1.2.0, 1.2.1
• Fix Version/s: 1.3.0
• Component/s: MLlib

Environment

Ubuntu 1410, Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode)
spark local mode

• Assignee: Sean R. Owen
• Reporter: Mike Beyer
• Created: 19/Dec/14 11:23
• Updated: 04/Apr/15 15:55
• Resolved: 04/Apr/15 15:54

Description

java.lang.reflect.InvocationTargetException
...
Caused by: java.lang.IllegalStateException: ARPACK returns non-zero info = 3 Please refer ARPACK user guide for error message.
at org.apache.spark.mllib.linalg.EigenValueDecomposition$.symmetricEigs(EigenValueDecomposition.scala:120)
at org.apache.spark.mllib.linalg.distributed.RowMatrix.computeSVD(RowMatrix.scala:235)
at org.apache.spark.mllib.linalg.distributed.RowMatrix.computeSVD(RowMatrix.scala:171)
...

Issue Links

• is related to: SPARK-1782 svd for sparse matrix using ARPACK
• links to: [Github] Pull Request #4485 (srowen)