[SPARK-17647] SQL LIKE does not handle backslashes correctly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.1, 2.2.0
• Component/s: SQL
• Labels: correctness
• Assignee: Xiangrui Meng
• Reporter: Xiangrui Meng
• Created: 23/Sep/16 15:55
• Updated: 13/Jan/21 22:02
• Resolved: 17/Apr/17 18:20

Description

Try the following in SQL shell:

select '\\\\' like '%\\%';

It returned false, which is wrong.

cc: yhuai joshrosen

A false-negative considered previously:

select '\\\\' rlike '.*\\\\\\\\.*';

It returned true, which is correct if we assume that the pattern is treated as a Java string but not raw string.

Issue Links

• supercedes: SPARK-19555 Improve inefficient StringUtils.escapeLikeRegex() method
• links to: [Github] Pull Request #15398 (jodersky)
• links to: [Github] Pull Request #17663 (felixcheung)