Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-7034

Window function over a malformed CSV file crashes the JVM

    Details

      Description

      The JVM crashes executing window functions over (an ordered) CSV file with a small format issue - an empty line.

      To create: Take the following simple `a.csvh` file:

      amount
      10
      11
      

      And execute a simple window function like

      select max(amount) over(order by amount) FROM dfs.`/data/a.csvh`;
      

      Then add an empty line between the `10` and the `11`:

      amount
      10
      
      11
      

      and try again:

      0: jdbc:drill:zk=local> select max(amount) over(order by amount) FROM dfs.`/data/a.csvh`;
      +---------+
      | EXPR$0  |
      +---------+
      | 10      |
      | 11      |
      +---------+
      2 rows selected (3.554 seconds)
      0: jdbc:drill:zk=local> select max(amount) over(order by amount) FROM dfs.`/data/a.csvh`;
      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      #  SIGSEGV (0xb) at pc=0x00000001064aeae7, pid=23450, tid=0x0000000000006103
      #
      # JRE version: Java(TM) SE Runtime Environment (8.0_181-b13) (build 1.8.0_181-b13)
      # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.181-b13 mixed mode bsd-amd64 compressed oops)
      # Problematic frame:
      # J 6719% C2 org.apache.drill.exec.expr.fn.impl.ByteFunctionHelpers.memcmp(JIIJII)I (188 bytes) @ 0x00000001064aeae7 [0x00000001064ae920+0x1c7]
      #
      # Core dump written. Default location: /cores/core or core.23450
      #
      # An error report file with more information is saved as:
      # /Users/boazben-zvi/IdeaProjects/drill/hs_err_pid23450.log
      #
      # If you would like to submit a bug report, please visit:
      #   http://bugreport.java.com/bugreport/crash.jsp
      #
      Abort trap: 6 (core dumped)
      

        Attachments

        1. hs_err_pid23450.log
          55 kB
          Boaz Ben-Zvi
        2. janino8470007454663483217.java
          10 kB
          Boaz Ben-Zvi

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ben-zvi Boaz Ben-Zvi
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: