Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4845

Malformed CSV throws IllegalArgumentException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.6.0, 1.7.0
    • Fix Version/s: None
    • Component/s: Storage - Text & CSV
    • Labels:
      None
    • Environment:

      CentOS 7

      Description

      When reading CSV data, if lines are malformed, often an error such as the following is reported:

      Error: SYSTEM ERROR: IllegalArgumentException: length: -15150 (expected: >= 0)

      Neither the error message reported to the client (with verbose errors on), nor on the drillbit describe what or where the problem is.

      Perhaps the CSV parser can throw exceptions that would help in locating what in the source data is not parsing?

        Attachments

          Activity

            People

            • Assignee:
              paul-rogers Paul Rogers
              Reporter:
              mattk Matt Keranen
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: