[DRILL-5684] Add documentation for lineDelimiter

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.10.0, 1.11.0
• Component/s: Documentation
• Assignee: Bridget Bevens
• Reporter: Abhishek Girish
• Reviewer: Abhishek Girish
• Created: 24/Jul/17 15:41
• Updated: 24/Jul/17 15:41

Description

We need to document the lineDelimiter attribute in [1], [2]. Also possibly a note that if using Drill on Windows, the new line delimiter in text files can be different from that on Linux / Mac. If the delimited text data has \r\n as the lineDelimiter (carriage return & new line) and querying it from Drill doesn't work as expected, we need to update the format plugin, as shown in the example below:

"csv": {
      "type": "text",
      "extensions": [
        "csv"
      ],
      "lineDelimiter": "\r\n",
      "extractHeader": true,
      "delimiter": ","
    }

[1] https://drill.apache.org/docs/plugin-configuration-basics/#list-of-attributes-and-definitions
[2] https://drill.apache.org/docs/text-files-csv-tsv-psv/#configuring-drill-to-read-text-files