[SPARK-30109] PCA use BLAS.gemv with sparse vector

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: ML
• Assignee: Ruifeng Zheng
• Reporter: Ruifeng Zheng
• Created: 03/Dec/19 10:44
• Updated: 04/Dec/19 01:51
• Resolved: 04/Dec/19 01:50

Description

When PCA was first impled in SPARK-5521, at that time Matrix.multiply(BLAS.gemv internally) did not support sparse vector. So it worked around it by applying a complex matrix multiplication.

Since SPARK-7681, BLAS.gemv supported sparse vector. So we can directly use Matrix.multiply now.

Issue Links

• links to: GitHub Pull Request #26745