[SPARK-17299] TRIM/LTRIM/RTRIM strips characters other than spaces

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.1, 2.1.0
• Component/s: Documentation, SQL
• Assignee: Sandeep Singh
• Reporter: Jacob Evan Beard
• Created: 29/Aug/16 19:31
• Updated: 06/Sep/16 21:19
• Resolved: 06/Sep/16 21:18

Description

TRIM/LTRIM/RTRIM docs state that they only strip spaces:

http://spark.apache.org/docs/2.0.0/api/java/org/apache/spark/sql/functions.html#trim(org.apache.spark.sql.Column)

But the implementation strips all characters of ASCII value 20 or less:

https://github.com/apache/spark/blob/v2.0.0/common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java#L468-L470

Issue Links

• links to: [Github] Pull Request #14924 (techaddict)