[DRILL-7034] Window function over a malformed CSV file crashes the JVM

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.16.0
• Component/s: Execution - Relational Operators
• Assignee: Unassigned
• Reporter: Boaz Ben-Zvi
• Created: 08/Feb/19 23:38
• Updated: 13/Jun/19 10:24
• Resolved: 11/Mar/19 14:52

Description

The JVM crashes executing window functions over (an ordered) CSV file with a small format issue - an empty line.

To create: Take the following simple `a.csvh` file:

amount
10
11

And execute a simple window function like

select max(amount) over(order by amount) FROM dfs.`/data/a.csvh`;

Then add an empty line between the `10` and the `11`:

amount
10

11

and try again:

0: jdbc:drill:zk=local> select max(amount) over(order by amount) FROM dfs.`/data/a.csvh`;
+---------+
| EXPR$0  |
+---------+
| 10      |
| 11      |
+---------+
2 rows selected (3.554 seconds)
0: jdbc:drill:zk=local> select max(amount) over(order by amount) FROM dfs.`/data/a.csvh`;
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00000001064aeae7, pid=23450, tid=0x0000000000006103
#
# JRE version: Java(TM) SE Runtime Environment (8.0_181-b13) (build 1.8.0_181-b13)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.181-b13 mixed mode bsd-amd64 compressed oops)
# Problematic frame:
# J 6719% C2 org.apache.drill.exec.expr.fn.impl.ByteFunctionHelpers.memcmp(JIIJII)I (188 bytes) @ 0x00000001064aeae7 [0x00000001064ae920+0x1c7]
#
# Core dump written. Default location: /cores/core or core.23450
#
# An error report file with more information is saved as:
# /Users/boazben-zvi/IdeaProjects/drill/hs_err_pid23450.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#
Abort trap: 6 (core dumped)