[SPARK-8830] levenshtein directly on top of UTF8String

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Assignee: Tarek Auel
• Reporter: Reynold Xin
• Created: 06/Jul/15 04:55
• Updated: 10/Jul/15 07:58
• Resolved: 09/Jul/15 16:24

Description

We currently rely on commons-lang's levenshtein implementation. Ideally, we should have our own implementation to:

1. Reduce external dependency
2. Work directly against UTF8String so we don't need to convert to/from java.lang.String back and forth.

Issue Links

• links to: [Github] Pull Request #7236 (tarekauel)