[SPARK-31506] Sparse BLAS native optimization

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: ML
• Assignee: Unassigned
• Reporter: Xiaochang Wu
• Created: 21/Apr/20 07:11
• Updated: 21/Apr/20 07:19

Description

BLAS are highly optimized routines by the industry. If take advantage of it, we can leverage hardware vendors' low-level optimization when available. 

Sparse BLAS also has native optimization , but current BLAS in Spark only has native optimization for Dense and naive Java implementation for Sparse.

We would like to introduce native optimization support for Sparse BLAS operations related to machine learning and produce benchmarks.