[SPARK-5186] Vector.equals and Vector.hashCode are very inefficient and fail on SparseVectors with large size

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.1, 1.2.0, 1.2.1
• Fix Version/s: 1.2.2
• Component/s: MLlib
• Target Version/s: 1.1.2, 1.2.2
• Assignee: yuhao yang
• Reporter: Derrick Burns
• Created: 09/Jan/15 22:25
• Updated: 12/Mar/15 08:40
• Resolved: 12/Mar/15 08:40

Description

The implementation of Vector.equals and Vector.hashCode are correct but slow for SparseVectors that are truly sparse.

Issue Links

• relates to: SPARK-6288 Pyrolite calls hashCode to cache previously serialized objects
• links to: [Github] Pull Request #3997 (hhbyyh)
• links to: [Github] Pull Request #4985 (mengxr)