[SPARK-11050] PySpark SparseVector can return wrong index in error message

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: MLlib, PySpark
• Labels: starter
• Target Version/s: 1.6.0
• Assignee: Bhargav Mangipudi
• Reporter: Joseph K. Bradley
• Shepherd: Joseph K. Bradley
• Created: 10/Oct/15 18:58
• Updated: 16/Oct/15 21:36
• Resolved: 16/Oct/15 21:36

Description

PySpark SparseVector._getitem_ returns an error message if given a bad index here:
https://github.com/apache/spark/blob/a16396df76cc27099011bfb96b28cbdd7f964ca8/python/pyspark/mllib/linalg/__init__.py#L770

But the index it complains about could have been modified (if negative), meaning the index in the error message could be wrong. This should be corrected.

Issue Links

• links to: [Github] Pull Request #9069 (bhargav)